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CORRELATION OF SOME PSYCHOLOGICAL AND' 
EDUCATIONAL MEASUREMENTS 



PROBLEMS 

"The results of all good experimental work will live, but as 
yet most of them are like hieroglyphics awaiting their decipher- 
ing Rosetta Stone." These are the words of Spearman. Such 
words are true of all fields of research, but they are worse than 
true of the field of Correlational Psychology. The Rosetta Stone 
of Correlational Psychology must do more than interpret ; it must 
reconcile. For this nothing less than a Philosopher's Stone will 
suffice, and Science, succeeding Black Magic, fully realizes that 
such a stone will not be found, but must be formed by a slow 
and laborious process. It is the hope that this study will con- 
tribute its small part to the making. 

Correlational Psychology is in this more or less chaotic condi- 
tion, not only because of poor experimental technique and diverse 
and inadequate statistical methods, but also because of the very 
great complexity, importance, and number of the problems which 
it has elected to attack. Such complexity, importance, and num- 
ber of problems is revealed by a very brief survey of the litera- 
ture on correlation. But not to go farther afield, it is excellently 
illustrated by the problems which it is the purpose of this re- 
search to examine. These problems follow: 

1. What are the intercorrelations among our psychological and 
educational tests or the functions which they measure? 

2. What is the relative value of each test as a measure of 
mental ability ? 

3. In the practical measurement of mental ability for educa- 
tional and vocational purposes which tests are the more valuable? 
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2 Correlation of Psychological "ayid Educational Measurements 

4. In the construction and in the application of psychological 
tests for the measurement of mental ability, do 'speed' tests or 
'power' tests offer'*more promise, whether as to correlation, con- 
venience,*t)r tfme spent ? 

5. What characteristics in a test make for high correlation with 
mental ability ? 

• 6. What is the value of improvement as a measure of mental 
ability ? 

7. What is the significance of chronological age as an intel- 
lectual index? 

8. Is there such a thing as a negative correlation between de- 
sirable traits? Is the law of human nature correlation or 
compensation ? 

9. Do our results support Spearman's "Theorem of the Uni- 
versal Unity of Intellective Function," or Burt's "Hierarchy of 
the Specific Intelligences"? 

These problems have been attacked experimentally. The fol- 
lowing pages describe the experiment, the use made of the data, 
and the results obtained. This experiment was devised originally 
to study problems other than those considered here. In fact, 
this study was not even conceived until the experiment was com- 
pleted. While this means a certain roughness of technique, it 
has the advantage of guaranteeing the impartiality of the data. 
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II 

EXPERIMENTAL MATERIAL AND METHOD 

I. Subjects 

The subjects for this experiment were eighty-eight public 
school children of an average age of about twelve and one-half 
years and about equally divided as to sex. These eighty-eight 
children were two typical 6B classes in a typical elementary school 
in New York City. The two class rooms adjoined and the teach- 
ers who had charge of the children used the departmental method 
of instruction. That is, the two teachers divided the subjects to 
be taught equally between them and each taught her allotted sub- 
jects to both classes. In this way both classes received exactly 
the same instruction. The classes were equal in mental ability 
as measured by what is later described as the six preliminary 
tests, though the last fact is not essential to this study. Further, 
it should be noted that while children were at the beginning 
shifted from one room to the other in order to make the classes 
equal in ability, in no case were children specially brought in 
from other classes. The eighty-eight children who made up the 
two classes were the children the experimenter found there when 
he began the experiment — ^they were typical classes. 

2. Tests with Their Administration and Scoring 

The general plan of the experiment was to give six preliminary 
tests, to follow these with an extended practice series, and to con- 
clude with six final tests which were to be similar to, but not 
identical with, the six preliminary ones. Certain special tests 
were given along with the practice series without interrupting it. 

In the administration of the tests every effort was made to 
treat both classes exactly alike. This was all the easier because 
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a test in one room was followed immediately by the same test in 
the other room. Written instructions were used at the beginning 
of each new test to avoid unconscious variation. During the 
practice series each class was tested for about half an hour. The 
testing began in one room half an hour after lunch and was con- 
cluded in the other room half an hour before the children were 
dismissed. The beginning class on one day would be the conclud- 
ing class on the following day. A teacher was always present 
when the children were being tested, though she took no part in 
the administration of the tests. The entire experiment was con- 
ducted by the author with the exception of the six preliminary and 
six final tests. Each of these sets was given to both classes in 
one day. This required an assistant, but even here the writer 
started every test and left the assistant to collect the papers. 

This experiment was throughout a group experiment, there 
being no individual testing. The detailed method for the practice 
series was as follows: The experimenter entered the class room 
and announced the names of the three pupils making the highest 
scores in each of the tests on the previous day. In addition to 
the regular procedure, if a new test were beginning, instructions 
were read and what was to be done was illustrated. Otherwise, 
the monitors distributed material face down. At the signal: 
Hands Up ! all raised their hands. At the signal : Go ! all began 
the test. At the signal: Stop! all ceased immediately, wrote 
their names and identification numbers on the sheets and turned 
them over to the monitors, who did the collecting. This was 
repeated for the other tests of that day, after which the experi- 
menter went through a similar procedure with the other class. 

The tests used on any one day during the practice series, the 
number of days they were used, the dates they were used, together 
with the average score made by both classes in each test are all 
shown in Table A. A brief description of the tests employed, 
the time allowed for each, and the method of scoring are given 
below. 

Preliminary and Final Tests 

Visual Vocabulary: The children were given the Thomdike 
Reading Scale A, which contains forty-three words. The first 
five words are easy and equally difficult. Each succeeding group 



^ -iW 



Experimental Material and Method 5 

of five words grows progressively more difficult. The last group, 
consisting of only three words, is the most difficult of all. Thus 
both the lower and upper limits of the ability of the children were 
measured. The children were to write the letter F under every 
word that meant a flower, and the letter A under every word that 
meant an animal, and so on. In this as in all the preliminary 
and final tests the time allowance was thirty minutes. If a child 
completed a test, leaving nothing undone, before the expiration 
of the half-hour, he could hand his paper to the experimenter. 
This last rule held not only for all the preliminary and final 
tests but also for the special tests which were sprinkled along 
during the practice experiment. The Visual Vocabulary was 
scored in terms of penalties : 

Score = Errors -f- Omissions, 

The final Visual Vocabulary Test was similar to, though not 
identical with, the one just described. The two tests were ad- 
ministered and scored in exactly the same way. 

Reading: Thorndike's Reading Scale Alpha was used. This 
scale contains four paragraphs, each one being more difficult to 
comprehend than the preceding. Each paragraph was followed 
by several questions. The child's written answers to these ques- 
tions were taken as a measure of his comprehension of the para- 
graph. A complete sentence was not required of the child, one 
word sometimes being sufficient to express the idea. Time al- 
lowed : 30 minutes. 

Score == 2 (correct answers) -f- ^ (semi-correct answers). 

The final Reading Test is similar. I, J, K and L of Thomdike's 
longer Reading Scale were used. The scoring was identical. 

Completion: The Trabue Completion Test, consisting of 
twenty-eight mutilated sentences, was used. The difficulty of 
completing the first sentence is small, but there is a gradual in- 
crease in difficulty with each succeeding one. The child was to 
write in the missing word or words. Time allowed : 30 minutes. 

Score = 2 (sentences completed correctly) -f- ^ (sentences 
completed semi-correctly). 

A similar set of twenty-eight sentences was employed in the 
same way for the final test. 

Arithmetic: Six problems in arithmetic, which grew progres- 
sively more difficult, were selected for this test. The child 
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handed in his work with his answers, but only the answers which 
were correct received a score. 

Score == Number of problems correctly solved. 

Six similar problems were used for the final test. 

Omnibus I A: The Omnibus Test is so called because it rep- 
resents a compilation by Professor Thomdike of several tests 
which psychology has found valuable. These are Easy and Hard 
Opposites, Verb-Object, Supraordinate, Mixed Relation, Easy 
and Hard Direction, and Addition. Time allowed: Thirty min- 
utes. The method of scoring this as all the other Omnibus Tests 
varied with each special part, hence it would be tedious to give it. 
The method used was that devised by Professor Thorndike. 
Anyone who desires to use these tests is referred, for a copy 
of the method of scoring, to the Department of Educational 
Psychology, Teachers College. 

The Final Test was Omnibus I B which includes the same 
tests as the one just described, the only difference being a slight 
variation of the tasks. 

Omnibus II A: This tested reasoning ability, the ability to give 
the opposites to certain hard words, the ability to give a verb to 
a specified subject and to add the proper letters to unfinished 
words, and the ability to solve certain problems in arithmetic. 
Time allowed : Thirty minutes. 

Omnibus II B or the Final Test is a slight variation of Omni- 
bus II A. 

Special Tests 

Proverb: The Proverb Test was recently devised by Professor 
H. A. Ruger. It consists of thirteen English proverbs followed 
by their corresponding African proverbs. In some the similarity 
is easy to perceive; in others it is more difficult. The children 
were to match the proverbs. Time allowed : Fifteen minutes. 

Score = Number correctly matched. 

Other special tests were given from time to time but since these 
tests were not given twice they have not been used in this study. 
It is necessary that there be two measures of a function if a corre- 
lation is to be corrected for attenuation. The Ruger Proverb 
Test has been retained just because it was recently devised. 

Age: Because of its possible significance, the age of reaching 
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the grade has been used as a measure of the children. This age 
measure was taken from the official school record, and is ex- 
pressed in months. 

School Mark: This measure was an average of all the marks 
given by the two teachers to each child in each subject taught 
during the semester in which this experiment was being carried 
on. No previous marks have been used. 

Teacher Rank: The two teachers were each asked to rank the 
eighty-eight children for mental ability. These ratings were 
made independently, although it must be remembered that the 
teachers had often talked together concerning the children. 

Practice Tests 

Cancellation of 2's: For this the Woodworth- Wells Cancella- 
tion Sheet was used. This sheet contains a series of groups of 
five figures arranged in random order. The children were di- 
rected to cancel the figure 2. Time allowed : One minute. 

Score = 2 (number cancelled correctly) — 2 (number omit- 
ted) — 3 (number wrongly marked). 

Cancellation of fs: Exactly the same test as the above, except 
that the children cancelled the figure 3. 

Cancellation of A's: On the Cancellation A Sheet fifty capital 
letter A's were arranged at random among other letters of the 
alphabet of which there were fifty each. The children cancelled 
the letter A. The time allowed and the scoring were as in the 
Cancelling 2 Test. 

Cancellation of S's: In every respect the same as the preceding 
test except that the letter S was cancelled. 

Addition: The Addition sheet employed by Thomdike, Kirby, 
and others was used in this test. It is made up of columns of 
ten one-place numbers arranged in random order, no figure less 
than 2 being used. The children were to write the sum of each 
column of figures. Four similar sheets were rotated to prevent 
memorizing. Time allowed: Ten minutes. 

Score = Number of columns added correctly. 

Copying Addresses: This test was recently devised by Profes- 
sor Thomdike. A sheet containing twenty-five names arranged 
in alphabetical order was given to each child, together with the 
small directory from which the names were taken. The children 
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found in the directory the New York City address and wrote it 
beside the appropriate name. A different list of names was 
used each day. Time allowed: Ten minutes. 

Score = Ntunber of addresses correctly copied. 

Handwriting: Similar paragraphs were cut from the Youth's 
Companion and pasted on cards. Each child was given a para- 
graph and a sheet of blank paper with directions to copy as much 
of the paragraph as he could while writing as well as he could. 
This test was given twice each day, a new paragraph being used 
each time. It need hardly be said that in this test as well as 
the others all the children did exactly the same thing in any one 
test. Time allowed : Four minutes for each test. 

Score = I (number of lines or fraction of lines copied) minus 
i-io (each omission or error). 

Each omission or error counted as one (i). 

Any word or words omitted were of course deducted from 
the gross number of lines covered to get the figure which was 
substituted in the first parenthesis above. 

Miscellaneous Arithmetic: The children worked for twenty 
minutes each day in Thomdike's booklet "Exercises in Arith- 
metic No. 5." Since this test has never been accurately scored 
it was of little value for this study, consequently no further men- 
tion will be made of it. 
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TABLE A 

Practice Series: Average score made by 88 individuals in the tests 
shown at the top on the days shown at the left 
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Using this per cent, the score which would probably have been 
made on the day when the individual was absent, was calculated 
from the last score made before or the first score made after the 
absence. Table B gives the raw arrays for all the tests used for 
the entire eighty-eight subjects. By eliminating the individuals 
who were absent on single-test days and also those who were 
absent more than two odd or two even days for any one practice 
test, the eighty-eight subjects were reduced to sixty-three sub- 
jects. When the two or less absent days were filled in with the 
probable scores. Table C resulted. Let us call Table C the 
'corrected arrays.' 

In closing this discussion one further remark is necessary. The 
original intention was to use more special tests than are shown 
in Table B. While these were dropped later, they figured in 
the elimination of pupils. Still another fact must be noticed. The 
teachers, who gave their opinion of the children's mental ability, 
ranked them in order from one to eighty-eight. When many 
individuals were eliminated gaps occurred in their ranks. It was 
decided to close up these gaps and make the range from one to 
sixty-three. 

TABLE B 

Raw Arrays: Scores or average scores made by 88 children in the 
tests shown at the top of each column. Under the practice tests : Column 
I = average from odd days ; column 2 = average from even days ; figure 
to left of a parenthesis = total score from number of tests shown in the 
parenthesis. 
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50 


89.2 


41.6 


134.3 


143.3 


1024.0[7] 


150.8 


51 


86.8 


82.9 


422.0[7] 


56.0 


62.0 


79.8 


52 


66.9 


65.8 


62.0 


64.3 


67.0 


74.3 


53 


250.0[8] 


260.0C8] 


880.0C6] 


128.0[6] 


192.0C6] 


178.0C6] 


54 


50.6 


53.7 


150.5 


145.5 


148.3 


1079.0L7J 


55 


37.1 


40.0 


93.8 


96.5 


116.0 


121.3 


56 


207.0[8] 


221.0C9] 


794.0[7] 


810.0C6] 


832.0C6] 


902.0[6] 


57 


21.9 


211.0[9] 


58.3 


546.0L7] 


89.3 


94.8 


58 


64.5 


70.9 


104.1 


109.0 


116.4 


121.4 


59 


42.9 


45.2 


82.0 


84.0 


116.3 


122.5 


60 


23.9 


25.3 


87.5 


90.3 


99.3 


650.0[7] 


61 


27.0 


257.0C9] 


94.3 


105.5 


103.9 


101.3 


62 


89.2 


94.8 


115.0 


119.5 


129.3 


132.9 


63 


31.6 


28.2 


98.5 


106.3 


125.5 


129.3 


64 


284.0[9] 


263.0[9] 


89.8 


640.0[7] 


104.8 


740.0[7] 


65 


226.0C8] 


242.0C8] 


662.0C7] 


594.0[6] 


764.0[6] 


660.0[5] 


66 


57.2 


59.3 


87.0 


88.3 


106.0 


106.5 


67 


48.0 


51.9 


127.5 


133.8 


145.3 


149.3 


68 


501.0C9] 


445.0C8] 


470.0C6] 


494.0C6] 


564.0C6] 


602.0C6] 


69 


66.0C2] 


[0] 


170.0C2] 


170.0C2] 


275.0[3] 


204.0L2] 


70 


29.9 


30.9 


78.5 


85.3 


692.0[7] 


106.5 


71 


405.0[9] 


45.3 


720.0C7] 


102.0 


822.0C7] 


126.8 


72 


87.9 


90.8 


103.3 


105.8 


115.0 


121.3 


73 


40.6 


43.7 


118.9 


125.5 


129.0 


136.5 


74 


22.7 


24.6 


93.3 


97.8 


735.0[7] 


107.0 


75 


29.3 


27.3 


142.8 


139.5 


141.8 


148.5 


76 


50.5 


55.8 


112.8 


126.8 


128.3 


136.8 


77 


22.4 


24.3 


120.3 


130.0 


1098.0[7] 


169.1 


78 


40.6 


42.0 


82.3 


91.5 


102.8 


111.0 


79 


708.0[9] 


80.8 


752.0m 


114.1 


900.0[7] 


129.3 


80 


93.8 


.99.4 


722.0C7] 


736.0[7] 


106.3 


117.0 


81 


65.6 


66.6 


111.5 


120.3 


132.0 


132.8 


82 


44.9 


429.0E9] 


113.1 


732.0E6] 


132.5 


980.0[71 


83 


277.0[8] 


283.0[6] 


568.0[6] 


546.0[6] 


690.0[6] 


645.0[6: 


84 


39.7 


40.8 


135.0 


141.0 


151.5 


1063.0C7: 
404.0E4 


85 


151.0[5] 


204.0[6] 


272.0[4] 


354.0C5] 


378.0[4] 


86 


19.9 


19.3 


102.0 


101.8 


118.0 


118.5 


87 


29.4 


803.0C9] 


108.0 


110.8 


130.5 


138.8 


88 


26.7 


27.9 


82.8 


90.3 


87.8 


97.8 


89 


264.0[4] 


197.0E3] 


350.0[4] 


298.0[8] 


454.0[4] 


832.0[3] 


90 


53.0 


54.8 


134.0 


131.0 


138.6 


145.8 


91 


40.3 


368.0C8] 


102.8 


724.0[7] 


131.5 


958.0m 


93 


45.4 


416.0[9: 


89.0 


91.3 


109.5 


111.8 


98 


428.0[9] 


439.0[9 


572.0L7J 


484.0[6] 


708.0C7] 


804.0C7] 
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TABLE B (continued) 
Ind. Cancelling A Cancelling S Copying Addresses 

7 tests 7 tests 4 tests 4 tests 10 tests 10 tests 

13 13 1 2 



1 


54.6 


3 


42.0 


S 


47.3 


4 


50.9 


6 


800.0C6] 
353.0C6] 





7 


43.7 


8 


45.1 


9 


404.0C5] 


10 


39.4 


11 


51.9 


13 


803.0C5] 


13 


69.1 


14 


58.0 


15 


88.1 


16 


57.1 


17 


39.4 


18 


53.7 


19 


49.4 


30 


46.6 


31 


56.0 


33 


398.0[6] 


33 


54.0 


34 


70.6 


85 


359.0[5] 
376.0[6] 


30 


87 


60.6 


38 


250.0C6] 


39 


59.7 


30 


258.0C6] 


81 


88.6 


83 


49.4 


83 


72.9 


84 


132.0[8] 


85 


40.9 


86 


86.9 


87 


80.6 


88 


41.7 


89 


41.7 


40 


0[11 


41 


50.3 
318.6[6] 


43 


48 


58.3 


44 


75.4 


50 


55.4 


51 


45.4 


53 


31.1 


58 


280.0[6] 


54 


55.9 


55 


84.9 


56 


856.0[6] 


57 


44.6 


58 


65.3 


59 


89.7 


60 


42.8 


61 


48.9 


63 


56.0 


63 


64.6 


64 


367.0[6] 


65 


44.3 


66 


85.1 


67 


48.7 


68 


306.0C6] 


69 


100.0C8] 


70 


50.9 


71 


58.1 


73 


51.7 


73 


58.7 


74 


48.1 


75 


76.8 


76 


50.8 


77 


57.4 


78 


41.4 



65.7 


65.5 


73.5 


396.0C6] 


53.0 


60.0 


50.3 


43.3 


46.0 


54.k 


63.0 


65.5 


370.0t5] 


310.0C8] 


336.0[81 
86.0C3] 


375.0[6] 


-5.0 


56.6 


40.0 


85.0 


377.0C5] 
444.0[6: 


57.3 


60.0 


78.0 


77.0 


46.0 


51.0 


55.3 


888.0C6] 
843.0[5] 


49.5 


148.0[3] 


136.0C2] 


164.0[3] 


70.0 


61.0 


66.0 


58.9 


75.3 


80.5 


87.7 


85.5 


83.0 


58.1 


65.8 


70.8 


35.1 


84.5 


44.5 


56.6 


59.0 


63.5 


51.9 


60.0 


53.5 


46.6 


71.8 


77.5 


58.0 


77.5 


77.5 


46.3 


84.0 


78.3 


51.4 


56.0 


66.5 


433.0C6] 


93.5 


284.0[3] 


804.0[5] 


128.0C2] 


146.0C2] 


65.1 


75.5 


75.5 


68.3 


72.0 


64.5 


44.6 


160.0C3] 


58.0 


324.0C6] 


73.5 


74.5 


37.7 


58.5 


64.0 


232.0C6] 


60.5 


62.5 


52.4 


71.5 


66.5 


71.7 


57.0 


62.0 


154.0C3] 


[0] 


[0] 


41.4 


55.0 


59.5 


40.6 


18.5 


108.0[3] 


90.9 


82.0 


87.0 


38.6 


52.0 


56.5 


46.0 


77.5 


81.0 


36.0[2] 


[0] 


[0] 


50.6 


132.0C3; 
145.0[2: 


51.5 


858.0C5] 


228.0[8] 


58.3 


63.5 


64.5 


73.4 


68.5 


67.0 


65.4 


76.8 


86.0 


55.4 


39.8 


157.0C8] 


33.1 


42.0 


44.0 


816.0[6] 


178.0C3] 


200.0C8] 


73.0 


49.0 


55.5 


44.9 


51.5 


49.5 


58.3 


80.5 


82.0 


46.3 


52.5 


59.5 


70.9 


68.5 


69.3 


44.9 


72.0 


76.0 


43.7 


48.5 


53.0 


834.0[6] 


66.0 


304.0[3] 


60.3 


69.8 


76.0 


62.0 


65.5 


66.5 


49.7 


170.0[8] 


62.0 


47.7 


43.5 


59.0 


42.0 


68.0 


71.0 


48.0 


60.5 


61.8 


310.0[5] 
84.0L3} 


156.0[31 
26.0[1] 


174.0[81 
[01 


54.9 


49.5 


53.5 


56.7 


66.0 


68.5 


58.7 


53.0 


60.0 


58.3 


78.0 


212.0[3] 


48.9 


68.0 


68.0 


87.8 


89.8 


91.5 


55.7 


64.5 


70.0 


56.9 


71.0 


77.0 


48.7 


45.0 


54.5 



19.6 


18.3 


32.5 


380.0C9] 


16.3 


18.3 


14.7 


16.6 


22.1 


188.0[8] 
117.0(9] 


11.8 


13.5 


15.8 


28.5 


35.4 


31.0 


38.0 


14.9 


16.5 


31.4 


345.0C9] 


58.0[5] 


89.0L6] 


35.8 


38.4 


17.1 


17.6 


17.4 


19.8 


19.0 


30.1 


16.6 


157.0[9] 


83.8 


35.3 


17.4 


19.4 


83.1 


32.8 


13.8 


14.6 


18.5 


160.0[91 
187.0[9 


17.4 


36.3 


246.0C9 
96.0 5] 


91.0C5] 


20.5 


22.4 


28.9 


29.3 


146.0C9] 


18.5 


26.6 


28.9 


25.5 


25.7 


158.019] 


16.5 


23.1 


23.5 


16.6 


15.3 


[0] 


[0] 


20.8 


23.2 


17.0 


158.0C9] 


21.1 


21.7 


15.6 


16.0 


18.5 


20.2 


£0] 


[01 


18.9 


18.8 


29.7 


28.1 


17.5 


16.8 


148.0C8] 


182.0C91 
249.0[9] 


25.3 


21.8 


23.3 


14.7 


142.0[9] 
210.0C9] 


178.0[8] 


22.6 


38.1 


16.2 


19.1 


184.0C9] 


308.0C9] 


17.4 


18.0 


31.5 


28.0 


18.1 


18.8 


19.1 


19.1 


14.4 


180.0[9] 


23.5 


24.4 


17.3 


16.2 


204.0C91 
118.0L9] 


204.0[9] 


88.0L7] 


15.0 


16.7 


18.5 


19.9 


175.0C91 


21.8 


[0] 


[0] 


19.9 


83.4 


164.0C9] 


19.9 


20.5 


32.6 


14.1 


15.9 


17.8 


18.8 


18.8 


20.5 


39.8 


39.9 


33.7 


38.5 


19.5 


80.7 



Statistical Treatment of Results 



IS 



Ind. 



79 
80 
81 
82 
88 
84 
85 
86 
87 
88 
89 
90 
91 
92 
93 

Ind. 



Cancelling A 

7 tests 7 tests 

1 2 



Cancelling S 
4 tests 4 tests 
1 2 



Copying Addresses 
10 tests 10 tests 

1 2 



—31.1 

£2.1 

79.1 

08.9 
226.0C5] 

56.6 

26.0C1] 

58.6 

45.1 

41.7 
186.0[4] 

72.3 
324.0C6] 

43.1 

65.6 



—28.6 

54.4 

83.1 

432.0[6] 
268.0L5] 

66.0 
156.0C3] 

59.4 
339.0[6] 

42.9 
168.0[3] 

83.1 

322.0[51 
278.0C6] 

69.7 



26.0 

62.5 

66.5 

44.5 
164.0[2] 

62.5 

82.0C1] 

66.0 

58.0 

51.5 

60.0[1] 

86.0 
252.0[3] 
184.0C3] 

61.0 



1 


6.38 


2 


7.27 


3 


7.60 


4 


6.04 


5 


7.11 


6 


6.15 


7 


6.66 


8 


4.57 


9 


7.58 


10 


5.55 


11 


5.87 


12 


65.60[8] 


13 


9.43 


14 


6.52 


15 


4.65 


16 


7.22 


17 


4.89 


18 


6.19 


19 


6.51 


20 


6.75 


21 


5.97 


22 


6.99 


23 


6.41 


24 


6.31 


25 


6.08 


26 


5.85 


27 


7.90 


28 


7.02 


29 


7.29 


30 


4.90 


31 


47.60L8] 


32 


8.42 


33 


6.60 


34 


[0] 


35 


6.98 


36 


7.94 


37 


7.03 


38 


4.92 


39 


6.35 


40 


[0] 


41 


7.47 


42 


7.94 


43 


6.63 


44 


43.30[6] 


50 


8.69 


51 


6.70 


52 


5.43 


53 


50.00E8] 


54 


7.24 


55 


5.76 


56 


9.61 


57 


5.25 


58 


6.49 


59 


7.31 


60 


6.83 



Handwriting 
10 tests 10 tests 



6.42 
60.00C8] 

6.99 

6.15 
58.20C8] 
48.40[8] 

6.79 

4.38 

7.17 

5.68 

5.62 

7.55 

9.19 

6.61 

4.50 

6.88 

4.88 

6.34 

6.42 

6.35 

6.57 

7.34 

5.99 

5.95 

6.26 

5.97 

7.97 

7.07 

7.30 
43.00C8] 

5.87 

8.72 

6.55 
[0] 

7.35 

7.56 

6.78 
4.94 
6.07 

[0] 
7.07 
6.79 
6.61 
42.00E6] 
8.23 
6.65 

44.50[8] 
6.73 
7.59 
6.44 
8.98 
4.99 
6.57 
6.68 
6.72 



27.0 

61.0 

69.5 
176.0C3] 
164.0C2] 

78.5 
200.0[3] 

67.5 
194.0C3] 

59.0 
[0] 

94.0 
264.0[3] 
182.0C3] 
184.0C3] 

Visual 
Vocabulary 
1 2 



12 
14 
25 
20 
17 
33 
80 
11 
24 
18 
14 
19 
21 
13 
25 
11 
14 
11 
16 
17 
20 
14 
15 
15 
15 
20 
4 
13 
18 
16 
10 
14 
12 

12 
5 

29 

20 

18 

13 

24 
8 

14 

21 

16 

20 

13 

18 

19 

80 

14 

15 

14 

21 

13 

18 



21 
13 
21 
26 
20 
37 
27 
24 
21 
24 
15 
22 
30 
6 
29 
23 
20 
21 
33 
24 
29 
21 
18 
21 

21 
14 
21 
23 
17 
22 
22 



10 
27 
26 
19 
21 

17 
19 
22 
23 
28 
16 
31 
25 
27 
21 

» 
23 
24 
83 



178.0C9] 

21.9 

30.5 

22.0 
202.0[9] 

19.9 
102.0[7] 

16.1 

17.5 

13.6 
[0] 

21.9 
178.0C9] 

22.2 
171.0[8] 



187.0[9] 

23.0 

82.5 

24.7 
206.0[9] 

22.6 
130.0[7] 

16.3 
167.0[9] 

15.3 
[0] 

24 7 
194.'0[9] 
207.0[9] 
211.0C9] 



Completion 
1 2 



30 
39 
29 
29 
32 
8 
31 
38 
27 
38 
26 
38 
27 
27 
28 
19 
38 
29 
26 
30 
27 
34 
25 
30 
33 
28 
43 
36 
24 
28 
31 
30 
36 
86 
47 
25 
30 
30 
29 
22 
38 
30 
23 
25 
28 
38 
27 
81 
28 
24 
31 
82 
28 
32 
25 



17 
87 
23 
24 
24 
15 
26 
86 
24 
25 
32 
35 
26 
28 
30 
27 
38 
82 
26 
81 
28 
81 
31 
29 

^ 
46 
25 
31 
88 
28 
30 
27 

41 
25 
80 
30 
80 

W 
83 

^ 
27 
82 
30 
25 
26 
26 

29 
27 
34 
20 
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TABLE B (continued) 



Ind. 



01 
82 
63 
64 
65 
66 
67 
68 
60 
70 
71 
72 
73 
74 
75 
76 
77 
78 
70 
80 
81 
82 
83 
84 
85 
86 
87 
88 
80 
90 
91 
92 
93 



Ind. 



1 
2 
8 
4 

6 
6 
7 
8 
9 
10 
11 
12 
13 
14 
15 
16 
17 
18 
19 
20 
21 
22 
23 
24 
25 
26 
27 
28 
29 
80 
31 
82 
38 
84 



Handwriting 




Visual 










10 tests 


10 tests 




Vocabulary 




Completion 


1 




2 




1 




2 




1 


2 


5.16 




5.07 




15 




26 




29 


28 


7.33 




7.62 




12 




15 




33 


37 


5.43 




5.78 




18 




29 




80 


30 


7.03 




6.92 




6 




_ 




39 


— 


7.89 




63.00C8] 




7 




28 




19 


22 


7.12 




7.30 




16 




24 




27 


28 


7.87 




8.32 




19 




80 




25 


25 


7.72 




8.56 




9 




13 




43 


— 


[0] 




[0] 




35 




_ 




25 


— 


6.99 




7.13 




22 




28 




29 


27 


6.58 




6.19 




18 




23 




31 


30 


7.10 




6.91 




14 




22 




38 


32 


7.05 




7.08 




15 




33 




22 


20 


6.08 




6.88 




16 




23 




30 


25 


8.21 




8.06 




24 




25 




22 


20 


9.41 




8.93 




14 




24 




30 


33 


7.15 




7.35 




15 




24 




29 


— 


5.60 




5.45 




14 




21 




35 


35 


6.52 




6.60 




15 




33 




28 


23 


8.14 




7.85 




11 




17 




42 


42 


9.47 




9.60 




12 




20 




38 


37 


7.41 




7.47 




17 




30 




37 


33 


53.70C8] 




60.80C8] 




9 




22 




36 


28 


6.29 




6.52 




11 




21 




31 


33 


36.10[6] 




37.30[6] 




16 




24 




34 


80 


6.90 




7.04 




16 




18 




25 


28 


6.17 




6.46 




20 




31 




19 


83 


5.63 




5.91 




14 




26 




29 


28 


[0] 




[0] 




20 




— 




33 




7.23 




7.47 




21 




19 




22 


80 


7.35 




7.39 




23 




20 




28 




8.42 




8.41 




12 




16 




34 


36 


60.10C8] 




7.32 




15 




23 




31 


23 


Arithmetic 






Reading 




Omnibus I 
















A 




B 


1 


2 




1 




2 




1 




2 




5 




21 




24 




41.0 




41.0 




5 




30 




36 




20.0 




19.0 




5 




23 




28 




42.5 




39.5 




2 




27 




27 




43.0 




46.0 




2 




24 




31 




30.0 




30.0 




1 




17 




12 




66.0 




64.0 




2 




19 




16 




43.0 




43.5 




4 




29 




28 




29.5 




22.5 




5 




29 




16 




32.0 




89.5 




2 




22 




31 




37.5 




43.0 




4 




31 




37 




32.0 




47.5 




6 




27 




43 




30.0 




28.0 




3 




18 




26 




32.0 




41.0 




4 




21 




23 




46.0 




43.0 




1 




26 




28 




32.0 




31.5 




8 




31 




32 




39.0 




42.0 





2 




29 




28 




44.5 




44.0 


3 


2 




28 




32 




27.5 




26.0 


3 


4 




26 




28 




35.5 




35.0 


2 


4 




21 




33 




20.5 




34.5 




2 




26 




31 




54.0 




44.0 




8 




28 




31 




34.0 




40.0 




4 




24 




37 




25.0 




32.0 




4 




29 




34 




31.5 




27.0 




— 




29 




— . 




31.5 








4 




24 




25 




30.0 




39.0 




5 




32 




43 




7.5 




19.5 




3 




25 




27 




39.5 




24.0 




4 




23 




35 




50.0 




42.0 




3 




26 




31 




25.5 




25.5 




3 




27 




28 




44.0 




29.5 




2 




25 




39 




17.5 




29.0 




— 




27 




28 




42.5 




33.0 




— 




26 




— 




25.0 
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Ind. 



85 
36 
37 
38 
39 
40 
41 
42 
43 
44 
60 
61 
52 
63 
54 
66 
56 
57 
68 
69 
60 
61 
62 
68 
64 
65 
66 
67 
68 
69 
70 

n 

72 
73 
74 
75 
76 
77 
78 
79 
80 
81 
82 
83 
84 
85 
86 
87 
88 
89 
90 
91 
92 
93 



Ind. 

1 
2 
8 
4 

5 

7 
8 
y *^. 

V 10 
11 
12 
18 
14 
15 
16 
17 
18 
19 



Arithi 


netic 




1 


2 


1 


6 


3 


31 


6 


2 


25 


1 


8 


27 


5 


4 


25 


4 


4 


25 





.— . 


20 


6 


4 


25 


4 


8 


26 


4 


4 


28 


4 


3 


24 


2 


1 


22 


3 


5 


28 


3 


4 


27 


4 


4 


23 


2 


3 


21 


4 


4 


28 


2 


— 


23 


4 


3 


30 


3 


3 


24 


2 


3 


26 


6 


2 


30 


1 


4 


26 


3 


4 


25 


1 


3 


26 


3 


— 


30 


3 


2 


24 


1 


3 


25 


1 


3 


24 


5 


4 


28 


2 


— 


27 


4 


3 


23 


2 


4 


26 


6 


6 


26 


2 


4 


25 


5 


5 


27 


4 


8 


23 


2 


4 


22 


2 


2 


21 


4 


5 


23 


4 


1 V 


25 


5 


5 


25 


5 


3 


28 


3 


3 


27 





8 


21 


2 


4 


27 


6 


5 


29 


1 


8 


28 


1 


5 


25 


3 


5 


29 


5 




24 


1 


^ 


9 


8 


3 


28 


4 


4 


23 


3 


6 


26 


Omnibus n 


P 


A 


B 




1 


2 




89.6 


78.0 




46.0 


46.5 




71.0 


73.5 




82.0 


63.0 




63.0 


62.5 




94.0 


82.0 




69.6 


65.5 




39.0 


60.0 




69.5 


63.6 




64.6 


62.0 




76.0 


68.5 




87.0 


61.0 




82.0 


76.0 




82.0 


85.0 




82.0 


73.5 




01.0 


66.5 




79.0 


69.6 




63.0 


48.5 




66.6 


70.6 





Readi 


ng 




Omnibus 1 








A 


B 




2 




1 


2 




46 




10.5 


16.0 




21 




61.0 


44.0 




26 




28.6 


26.5 




37 




42.6 


30.6 




33 




27.0 


33.5 




.— 




36.0 






41 




15.6 


4.6 




40 




18.0 


30.0 




^— 




32.0 






38 




33.0 


30.0 




22 




34.0 


36.0 




36 




28.0 


13.5 




32 




42.0 


30.0 




31 




38.0 


34.6 




19 




43.0 


37.0 




37 




28.5 


36.6 




— 




31.0 






41 




30.0 


33.0 




30 




61.6 


27.6 




33 




22.6 


35.0 




28 




40.6 


36.0 




28 




66.6 


25.0 




39 




28.6 


19.6 




25 




69.6 


44.0 




— 




9.0 


8.0 




20 




69.0 


63.0 




40 




26.0 


34.0 




26 




31.5 


36.5 




— 




18.5 


17.0 




— 




60.0 






33 




30.0 


26.5 




34 




28.0 


30.0 




34 




17.0 


24.5 




22 




39.5 


44.0 




31 




35.0 


26.6 




33 




48.0 


49.0 




36 




37.0 


34.0 




— 




36.0 


26.0 




36 




28.6 


30.5 




16 




69.0 


64.0 




40 




28.5 


16.0 




46 




23.0 


13.5 




28 




29.5 


17.0 




32 




28.0 


41.0 




82 




34.5 


24.6 




43 




27.0 


27.0 




33 




34.5 


23.0 




36 




38.5 


30.0 




37 




37.6 


23.0 




— 




34.0 






27 




38.0 


39.5 




— 




35.5 


45.0 




38 




25.5 


31.0 




27 




36.5 


38.5 


overt 


» 


Teacher Rank 


Age in mo 






1 


2 




2 




64 


63 


166 


4 




39 


28 


163 


3 




29 


41 


146 


2 




72 


71 


163 


10 




25 


30 


166 


3 




88 


88 


172 


2 




80 


80 


156 


6 




16 


14 


137 


2 




33 


20 


151 


1 




42 


36 


163 


4 




37 


54 


163 


— 




44 


44 


173 


4 




60 


49 


136 


6 




82 


84 


148 


3 




41 


48 


134 


5 




70 


81 


166 


— . 




64 


69 


159 


8 




13 


29 


137 


8 




76 


68 


165 
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TABLE B (continued) 





Omnibus II 


Ind. 


A 


B 




1 


3 


10 


80.0 


68.6 


31 


84.6 


04.6 


XS 


81.0 


68.6 


It 


64.0 


48.0 


34 


78.0 


47.0 


35 


49.6 




30 


79.0 


08.0 


37 


84.6 


83.0 


38 


70.0 


67.6 


38 


81.0 


08.0 


30 


43.0 


64.0 


31 


78.0 


06.0 


83 


69.0 


69.6 


33 


83.6 


01.0 


84 


61.0 




86 


89.0 


40.0 


86 


70.0 


74.0 


87 


70.6 


81.6 


88 


76.6 


00.0 


89 


00.6 


44.6 


40 


101.6 




41 


60.0 


89!o 


43 


63.0 


78.0 


43 


78.0 




44 


04.0 


61.0 


60 


70.6 


70.0 


61 


47.6 


44.6 


63 


07.0 


04.0 


68 


80.6 


66.0 


64 


90.6 


77.0 


66 


00.0 


08.6 


60 


91.6 




67 


04.6 


82.0 


68 


80.6 


06.0 


60 


76.0 


78.0 


00 


81.6 


75.6 


01 


89.6 


72.0 


03 


60.0 


43.0 


08 


78.0 


01.6 


04 


84.0 


34.6 


06 


118.0 


89.0 


00 


03.0 


00.0 


07 


80.0 


72.0 


08 


36.0 


89.0 


00 


07.0 




70 


80.6 


05.0 


71 


83.0 


01.6 


73 


63.0 


43.6 


78 


79.0 


07.6 


74 


70.0 


02.6 


76 


88.0 


66.0 


70 


80.6 


78.6 


77 


73.6 


07.0 


78 


00.6 


04.6 


79 


80.6 


80.0 


80 


41.6 


80.0 


81 


47.6 


40.6 


83 


49.6 


66.6 


88 


80.6 


03.0 


84 


79.6 


08.6 


86 


67.6 


88.6 


80 


84.0 


06.0 


87 


78.0 


01.6 


88 


06.0 


08.0 


89 


04.0 




90 


94.0 


88.6 


91 


73.6 


04.6 


93 


03.0 


68.6 


98 


04.0 


00.6 



ProTcrb 



Teacher Rank 


Age in months 


1 


3 




06 


08 


144 


01 


01 


189 


00 


07 


108 


30 


18 


146 


10 


11 


148 


7 


8 


146 


78 


83 


183 


1 


4 


188 


84 


70 


166 


30 


30 


164 


81 


89 


160 


40 


46 


153 


65 


00 


108 


07 


79 


107 


00 


03 


163 


4 


6 


104 


71 


67 


148 


80 


SO 


101 


63 


84 


143 


18 


87 


150 


08 


00 


100 


8 


1 


164 


23 


38 


147 


80 


83 


140 


48 


81 


141 


69 


66 


140 


16 


9 


140 


86 


38 


150 


40 


40 


147 


80 


80 


108 


58 


40 


168 


81 


78 


188 


88 


60 


147 


9 


18 


186 


45 


88 


100 


75 


06 


100 


48 


61 


187 


14 





103 


09 


88 


160 


13 


83 


140 


87 


86 


190 


61 


63 


164 


74 


77 


166 


8 


13 


188 


88 


78 


100 


24 


48 


188 


49 


69 


140 


19 


7 


161 


79 


68 


180 


11 


15 


143 


67 


60 


158 


47 


31 


151 


82 


86 


141 


21 


22 


140 


86 


87 


154 





3 


143 


3 


8 


146 


6 


10 


183 


78 


70 


166 


50 


04 


148 


28 


42 


161 


08 


76 


148 


17 


24 


187 


84 


25 


144 


02 


10 


138 


58 


47 


150 


77 


74 


183 


27 


17 


150 


28 


19 


154 
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Corrected Arrays: Scores or average scores made by 63 children in 
the tests shown at the top of the column. Under the practice tests: 
Column I — average score from odd days; column 2 = average score 
from even days. The number of days is shown at the top. B = boy: 
G = girl. 



Ind. 


Addition 


Cancelling 2 


Cancelling 3 




10 


10 


8 


8 


8 


8 




tests 


tests 


tests 


tests 


tests 


tests 




1 


3 


1 


3 


1 


2 


IB. 


102.7 


105.7 


138.0 


142.0 


153.5 


160.0 


2B. 


S8.S 


38.7 


92.3 


98.1 


111.5 


113.3 


3B. 


71.1 


71.9 


98.8 


105.5 


117.5 


119.5 


4G. 


S0.0 


38.7 


87.3 


91.8 


103.5 


106.1 


7G. 


42.1 


45.9 


79.4 


92.0 


105.0 


110.3 


9B. 


M.5 


58.5 


182.0 


136.5 


133.3 


135.8 


lOB. 


9.8 


12.0 


70.0 


74.0 


92.0 


104.8 


IIB. 


18.4 


16.5 


98.5 


111.8 


121.0 


124.5 


13B. 


91.S 


94.9 


180.3 


138.9 


157.5 


162.5 


14B. 


71.4 


76.4 


113.8 


119.0 


121.8 


120.5 


15G. 


27.8 


31.8 


105.3 


106.0 


138.0 


132.0 


16B. 


47.0 


49.8 


108.3 


115.0 


125.8 


125.4 


18G. 


ei.4 


64.6 


87.5 


96.5 


103.8 


105.5 


19G. 


80.7 


84.7 


93.5 


94.0 


101.5 


104.8 


30G. 


67.0 


63.3 


95.5 


106.3 


123.5 


124.9 


21G. 


23.5 


26.5 


111.8 


114.3 


120.5 


125.3 


23B. 


S4.3 


54.9 


100.0 


107.3 


114.8 


124.5 


24G. 


S0.8 


57.3 


105.5 


102.9 


122.0 


124.0 


26G. 


Sl.l 


50.4 


84.0 


91.8 


99.8 


106.3 


27G. 


57.4 


58.7 


100.8 


113.8 


113.0 


116.3 


28G. 


21.8 


23.0 


97.5 


103.8 


117.8 


124.8 


29B. 


36.2 


36.5 


124.0 


112.9 


183.0 


138.3 


SOB. 


53.2 


56.4 


73.6 


76.8 


90.0 


92.5 


SIB. 


14.5 


14.7 


82.3 


83.8 


101.5 


105.3 


S2B. 


42.5 


44.1 


108.6 


111.8 


122.8 


125.3 


Z5B. 


40.2 


40.8 


76.5 


86.8 


98.3 


101.8 


37G. 


64.0 


70.4 


100.8 


110.4 


117.2 


120.5 


88B. 


20.6 


22.0 


82.8 


84.3 


97.5 


100.3 


89G. 


52.7 


53.2 


88.8 


90.3 


113.3 


112.0 


41B. 


35.5 


37.8 


83.0 


85.0 


93.0 


92.3 


42B. 


70.3 


74.8 


97.6 


96.6 


113.9 


113.8 


50G. 


39.3 


41.6 


134.3 


143.3 


144.0 


150.8 


51G. 


86.8 


82.9 


64.6 


56.0 


62.0 


79.8 


52G. 


66.9 


65.8 


62.0 


64.3 


67.0 


74.3 


54G. 


50.6 


53.7 


150.5 


145.5 


148.3 


150.9 


55B. 


37.1 


40.0 


93.8 


96.5 


116.0 


121.3 


57G. 


21.9 


23.4 


58.3 


74.1 


89.3 


94.8 


68B. 


64.5 


70l9 


104.1 


109.0 


116.4 


121.4 


S9B. 


42.9 


45.2 


82.0 


84.0 


116.3 


122.5 


60B. 


23.9 


25.3 


87.5 


90.3 


99.3 


95.4 


eiB. 


27.0 


28.4 


94.3 


105.5 


103.9 


101.3 


•2B. 


89.2 


94.8 


115.0 


119.5 


129.3 


132.9 


«3G. 


31.6 


28.2 


98.5 


108.3 


125.5 


129.3 


66B. 


57.2 


59.3 


87.0 


88.3 


108.0 


106.5 


67B. 


48.0 


51.9 


127.5 


133.8 


145.3 


149.3 


TOG. 


29.9 


30.9 


78.5 


85.3 


98.3 


106.5 


71B. 


45.0 


45.3 


106.6 


102.0 


120.1 


126.3 


72B. 


87.9 


90.8 


103.3 


105.8 


115.0 


121.3 


73B. 


40.6 


43.7 


118.9 


125.5 


129.0 


136.5 


74G. 


22 7 


24.6 


93.3 


97.8 


106.8 


107.0 


76G. 


29.3 


27.3 


142.8 


139.5 


141.8 


148.5 


76B. 


50.5 


55.8 


112.8 


126.3 


128.3 


136.3 


78B. 


40.6 


42.0 


82.3 


91.5 


102.8 


111.0 


SOB. 


93.8 


99.4 


97.4 


104.0 


106.3 


117.0 


82G. 


44.9 


47.7 


113.1 


119.8 


132.5 


138.7 


8SG. 


33.6 


34.5 


94.9 


95.6 


113.7 


108.9 


84G. 


39.7 


40.8 


185.0 


141.0 


151.5 


155.4 


86G. 


19.9 


19.3 


102.0 


101.8 


118.0 


118.5 


87G. 


29.4 


33.4 


106.0 


110.8 


130.5 


138.8 


88B. 


26.7 


27.9 


82.8 


90.3 


87.8 


97.8 


OOB. 


53.0 


54.8 


134.0 


131.0 


138.6 


145.8 


92B. 


45.4 


47.1 


89.0 


91.3 


109.5 


111.8 


93B. 


48.5 


49.0 


82.5 


82.5 


104.8 


115.7 


Av. 


= 47.1 


49.2 


99.8 


m.i 


115.6 


119.8 
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TABLE C (continued) 

Copying 

Cancelling A Cancelling S Addresses Handwriting 

7 7 4 4 10 10 10 10 

Ind. tests tests tests tests testa tests tests tests 

12 12 12 12 

IB. 

2B. 

SB. 

4G. 

7G. 

OB. 
lOB. 
IIB. 
13B. 
14B. 
15G. 
16B. 
180. 
19G. 
20G. 
21G. 
28B. 
24G. 
26G. 
27G. 
28G. 
29B. 
SOB. 
81B. 
S2B. 
85B. 
87G. 
88B. 
39G. 
41B. 
42B. 
50G. 
51G. 
52G. 
54G. 
55B. 
57G. 
MB. 
59B. 
60B. 

eiB. 

628. 
63G. 
66B. 
67B. 
70G. 
71B. 
72B. 
73B. 
74G. 
7«G. 
76B. 
78B. 
SOB. 
82G. 
83G. 
84G. 
86G. 
87G. 
88B. 
90B. 
92B. 
93B. 
Av. : 



54.6 


65.7 


65.5 


73.5 


19.6 


18.3 


6.4 


6.4 


42.0 


47.8 


52.0 


60.0 


22.5 


24.9 


7.3 


7.S 


47.3 


50.3 


43.3 


46.0 


16.3 


18.2 


7.6 


7.0 


50.0 


54.1 


63.0 


65.5 


14.7 


16.6 


6.0 


6.2 


43.7 


56.6 


40.0 


35.0 


13.5 


15.8 


6.7 


6.8 


71.9 


77.3 


78.0 


77.0 


21.0 


23.0 


7.6 


7.2 


39.4 


46.0 


51.0 


55.3 


14.9 


16.5 


5.6 


5.7 


51.9 


56.2 


49.5 


50.1 


21.4 


26.2 


5.9 


5.6 


69.1 


70.0 


61.0 


66.0 


25.8 


28.4 


9.4 


9.2 


58.0 


58.9 


75.3 


80.5 


17.1 


17.6 


6.5 


6.6 


88.1 


87.7 


85.5 


83.0 


17.4 


19.3 


4.7 


4.5 


57.1 


58.1 


65.3 


70.8 


19.0 


20.1 


7.2 


6.9 


53.7 


56.6 


59.0 


62.5 


22.3 


25.2 


6.2 


6.8 


49.4 


51.9 


60.0 


52.5 


17.4 


19.4 


6.5 


6.4 


46.6 


46.6 


71.8 


77.5 


22.1 


22.8 


6.8 


6.4 


56.0 


58.0 


77.5 


77.5 


13.8 


14.6 


6.0 


6.6 


54.0 


51.4 


56.0 


66.5 


17.4 


19.7 


6.4 


6.0 


70.6 


74.7 


93.5 


97.8 


26.3 


30.6 


6.8 


6.0 


59.2 


65.1 


75.5 


75.5 


20.5 


22.4 


5.9 


6.0 


60.6 


68.3 


72.0 


64.5 


28.9 


29.3 


7.9 


8.0 


43.6 


44.6 


53.6 


58.0 


16.4 


18.5 


7.0 


7.1 


59.7 


58.7 


73.5 


74.5 


26.6 


28.9 


7.S 


7.8 


89.7 


87.7 


58.5 


64.0 


25.5 


25.7 


4.9 


5.4 


38.6 


40.2 


60.5 


62.5 


17.2 


16.5 


5.0 


5.9 


49.4 


52.4 


71.5 


66.5 


23.1 


23.5 


8.4 


8.7 


40.9 


41.4 


55.0 


59.5 


20.8 


23.2 


7.0 


7.4 


80.6 


90.9 


82.0 


87.0 


21.1 


21.7 


7.0 


6.8 


41.7 


38.6 


52.0 


56.5 


15.6 


16.0 


4.9 


4.9 


41.7 


46.0 


77.5 


81.0 


18.5 


20.2 


6.4 


6.1 


50.3 


50.6 


43.3 


51Ji 


18.9 


18.8 


7.5 


7.1 


55.0 


60.0 


51.3 


61.5 


29.7 


28.1 


7.9 


6.8 


55.4 


65.4 


76.8 


86.0 


25.3 


27.8 


8.6 


8.2 


45.4 


55.4 


39.8 


52.9 


21.8 


23.3 


6.7 


6.7 


31.1 


33.1 


42.0 


44.0 


14.7 


14.4 


5.4 


5.5 


55.9 


73.0 


49.0 


55.5 


22.6 


23.1 


7.2 


7.6 


34.9 


44.9 


51.5 


49.5 


16.2 


19.1 


5.8 


6.4 


44.6 


46.3 


52.5 


59.5 


17.4 


18.0 


5.3 


5.0 


65.8 


70.9 


68.5 


69.3 


21.5 


23.0 


6.5 


6.6 


39.7 


44.9 


72.0 


76.0 


18.1 


18.8 


7.3 


6.7 


42.3 


43.7 


48.5 


53.0 


19.1 


19.1 


6.8 


6.7 


48.9 


55.4 


66.0 


69.5 


14.4 


15.7 


5.2 


5.1 


56.0 


60.3 


69.8 


76.0 


23.5 


24.4 


7.8 


7.6 


64.6 


62.0 


65.5 


66.5 


17.3 


16.2 


5.4 


5.8 


35.1 


42.0 


68.0 


71.0 


15.0 


16.7 


7.1 


7.S 


43.7 


48.0 


60.5 


61.8 


18.5 


19.9 


7.9 


8.3 


50.9 


54.9 


49.5 


53.5 


19.9 


22.4 


7.0 


7.1 


58.1 


56.7 


66.0 


68.5 


21.3 


19.9 


5.6 


6.2 


51.7 


53.7 


53.0 


60.0 


20.5 


22.6 


7.1 


6.9 


53.7 


58.3 


73.0 


73.7 


14.1 


15.9 


7.1 


7.1 


43.1 


48.9 


68.0 


68.0 


17.8 


18.8 


6.1 


6.9 


76.S 


87.8 


89.3 


91.5 


18.8 


20.5 


8.2 


8.1 


50.3 


55.7 


64.5 


70.0 


29.8 


29.9 


9.4 


8.9 


414 


43.7 


45.0 


54.5 


19.5 


20.7 


5.6 


5.5 


52.1 


54.4 


62.5 


61.0 


21.9 


23.0 


8.1 


7.9 


68.9 


73.3 


44.5 


56.1 


22.0 


24.7 


7.4 


7.5 


46.3 


52.7 


74.3 


77.4 


21.0 


22.3 


6.8 


7.5 


56.6 


66.0 


62.5 


78.5 


19.9 


22.6 


6.3 


6.5 


58.6 


59.4 


66.0 


67.5 


16.1 


16.3 


6.9 


7.0 


45.1 


54.9 


58.0 


65.2 


17.6 


18.6 


6.2 


6.5 


41.7 


42.9 


51.5 


59.0 


13.6 


15.8 


5.6 


5.9 


72.3 


83.1 


86.0 


94.0 


21.9 


24.7 


7.2 


7.5 


43.1 


46.5 


58.9 


61.7 


22.2 


23.0 


8.4 


8.4 


65.6 


69.7 


61.0 


63.4 


21.9 


28.1 


7.5 


7.S 


52.4 


50.7 


62.5 


65.0 


19.8 


19.9 


6.7 


6.8 
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Visual 



Ind. 


Vocal 


mlary 


Completion 


Arith. 


Reading 




1 


2 


1 


2 


1 


2 


1 


1 


1 


12 


21 


80 


17 


1 


5 


21 


24 


2 


14 


18 


89 


87 


4 


6 


30 


36 


8 


25 


21 


29- 


23 


4 


5 


28 


28 


4 


20 


26 


29 


24 


2 


2 


27 


27 


7 


30 


27 


81 


26 


2 


2 


19 


16 


9 


24 


21 


27 


24 


5 


5 


29 


16 


10 


18 


24 


88 


25 


2 


2 


22 


81 


11 


14 


15 


26 


82 


4 


4 


81 


37 


13 


21 


80 


27 


26 


4 


8 


18 


26 


14 


18 


6 


27 


28 


8 


4 


21 


23 


15 


25 


29 


28 


30 


1 


1 


26 


28 


16 


11 


23 


19 


27 


5 


8 


81 


82 


18 


11 


21 


29 


32 


3 


2 


28 


82 


19 


16 


83 


26 


26 


8 


4 


26 


28 


20 


17 


24 


80 


31 


2 


4 


21 


88 


21 


20 


29 


27 


28 


1 


2 


26 


81 


23 


15 


18 


25 


31 


4 


4 


24 


37 


24 


15 


21 


30 


29 


2 


4 


29 


34 


20 


20 


21 


28 


29 


2 


4 


24 


25 


27 


4 


14 


43 


46 


4 


5 


82 


43 


28 


18 


21 


36 


25 


1 


8 


25 


27 


20 


18 


23 


24 


31 


4 


4 


23 


85 


80 


16 


17 


28 


33 


3 


8 


26 


81 


31 


10 


22 


31 


28 


4 


8 


27 


28 


82 


14 


22 


80 


30 


1 


2 


25 


88 


35 


5 


10 


47 


41 


5 


3 


31 


46 


87 


20 


26 


80 


80 


1 


8 


27 


26 


88 


18 


19 


80 


30 


5 


4 


25 


37 


89 


18 


21 


29 


30 


4 


4 


25 


88 


41 


8 


17 


88 


36 


5 


4 


25 


41 


42 


14 


19 


80 


83 


4 


8 


26 


40 


50 


20 


28 


28 


27 


2 


1 


22 


22 


61 


18 


16 


38 


32 


3 


5 


28 


85 


52 


18 


81 


27 


80 


8 


4 


27 


82 


54 


80 


27 


28 


26 


2 


8 


21 


19 


55 


14 


21 


24 


26 


4 


4 


28 


37 


67 


14 


20 


32 


29 


4 


8 


30 


41 


68 


21 


23 


28 


27 


3 


3 


24 


80 


50 


18 


24 


82 


34 


2 


8 


26 


88 


00 


18 


83 


25 


20 


5 


2 


80 


28 


01 


15 


26 


29 


28 


1 


4 


26 


28 


62 


12 


15 


83 


87 


3 


4 


25 


89 


68 


18 


29 


30 


80 


1 


3 


25 


25 


66 


16 


24 


27 


28 


1 


3 


25 


40 


67 


19 


80 


25 


25 


1 


3 


24 


26 


70 


22 


28 


29 


27 


4 


8 


28 


88 


71 


18 


28 


31 


80 


2 


4 


26 


84 


72 


14 


22 


38 


82 


6 


6 


25 


84 


78 


15 


83 


22 


20 


2 


4 


25 


22 


74 


16 


23 


30 


25 


5 


5 


27 


81 


75 


24 


25 


22 


20 


4 


3 


23 


38 


76 


14 


24 


80 


83 


2 


4 


22 


86 


78 


14 


21 


85 


85 


4 


5 


23 


85 


80 


11 


17 


42 


42 


5 


5 


25 


40 


82 


17 


80 


87 


83 


3 


8 


27 


28 


88 


9 


22 


86 


28 





8 


21 


82 


84 


11 


21 


31 


83 


2 


4 


27 


82 


86 


16 


18 


25 


28 


1 


8 


28 


83 


87 


20 


81 


19 


38 


1 


5 


25 


85 


88 


14 


26 


29 


28 


8 


5 


29 


87 


90 


21 


19 


22 


30 


1 


4 


9 


27 


92 


12 


16 


34 


86 


4 


4 


23 


88 


93 


15 


23 


31 


23 


3 


5 


26 


27 


Av. 


=16.1 


22.6 


30. 


29.4 


2.9 


3.6 


25.2 


81.6 
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TABLE C (continued) 

Pro- Age in 



Id. 


Omnibus 


Terb M'nths T ch'r 


Rmnk School Mai 




1 


2 






1 


2 


1 


2 


1 


180.5 


119.0 


2 


155 


42 


41 


46 


48 


3 


65.0 


64.5 


4 


158 


80 


28 


55 


58 


8 


118.5 


118.0 


8 


145 


22 


82 


55 


51 


4 


125.0 


100.0 


2 


158 


58 


54 


48 


41 


7 


112.5 


109.0 


2 


156 


60 


58 


41 


45 


9 


101.5 


103.0 


2 


151 


25 


15 


61 


51 


10 


102.0 


105.0 


1 


168 


82 


27 


61 


49 


11 


107.0 


116.0 


4 


158 


28 


42 


49 


56 


13 


114.0 


117.0 


4 


136 


88 


87 


56 


56 


14 


128.0 


128.0 


6 


148 


61 


62 


88 


81 


16 


114.0 


105.0 


8 


184 


81 


86 


50 


61 


16 


180.0 


108.5 


5 


166 


52 


50 


88 


47 


18 


80.5 


74.5 


8 


137 


9 


24 


68 


71 


19 


101.0 


105.5 


8 


165 


57 


52 


46 


48 


90 


109.5 


98.0 


8 


144 


49 


49 


57 


66 


21 


188.5 


106.5 


1 


139 


48 


48 


80 


47 


28 


79.0 


75.0 


5 


145 


20 


18 


67 


68 


24 


100.5 


74.0 


4 


143 


7 


9 


76 


72 


26 


100.0 


107.0 


8 


182 


58 


60 


48 


41 


27 


42.0 


41.5 


11 


189 


1 


8 


74 


68 


28 


115.5 


81.5 


8 


155 


62 


56 


42 


52 


29 


131.0 


105.0 


7 


154 


15 


21 


59 


52 


80 


67.5 


79.5 


2 


150 


24 


80 


57 


54 


81 


122.0 


94.5 


8 


152 


85 


84 


50 


46 


82 


76.5 


88.5 


4 


162 


43 


47 


41 


55 


85 


49.5 


56.0 


11 


164 


8 


4 


68 


72 


87 


99.0 


57.0 


6 


161 


28 


22 


58 


58 


88 


118.0 


90.5 


5 


142 


40 


26 


60 


54 


89 


87.5 


78.0 


2 


150 


18 


28 


57 


61 


41 


74.5 


43.5 


11 


154 


2 


1 


76 


76 


42 


70.0 


102.0 


4 


147 


17 


18 


62 


57 


50 


110.5 


105.0 


5 


146 


47 


48 


55 


65 


51 


75.5 


58.0 


8 


140 


11 


7 


74 


69 


52 


100.0 


94.0 


4 


150 


27 


25 


65 


€5 


54 


183.5 


114.0 


1 


168 


68 


63 


36 


44 


55 


88.5 


100.0 


5 


158 


46 


81 


47 


46 


57 


94.5 


65.0 


1 


147 


29 


44 


59 


66 


58 


183.0 


92.5 


4 


185 


6 


10 


72 


68 


59 


98.5 


108.0 


10 


160 


84 


29 


54 


59 


60 


122.0 


110.5 


8 


166 


56 


51 


87 


51 


61 


145.0 


97.0 


5 


187 


88 


89 


55 


58 


62 


78.5 


62.5 


5 


162 


10 


5 


69 


78 


68 


137.5 


105.5 


2 


156 


51 


61 


50 


51 


66 


89.0 


94.0 


5 


154 


39 


40 


62 


57 


67 


117.5 


107.5 


4 


155 


55 


57 


48 


60 


70 


116.5 


91.5 


5 


188 


19 


83 


58 


66 


71 


110.0 


91.5 


2 


140 


87 


46 


58 


56 


72 


70.0 


67.0 


9 


151 


14 


6 


69 


69 


78 


118.5 


111.5 


5 


180 


59 


45 


41 


89 


74 


111.0 


89.0 


4 


142 


8 


11 


66 


68 


75 


131.0 


104.0 


8 


158 


45 


88 


51 


60 


76 


117.5 


107.5 


4 


151 


86 


16 


58 


56 


78 


89.0 


95.0 


2 


140 


16 


17 


67 


70 


80 


70.0 


52.0 


7 


142 


5 


2 


78 


77 


82 


79.0 


72.5 


11 


182 


4 


8 


73 


76 


88 


108.5 


142.5 


2 


155 


54 


58 


89 


68 


84 


114.0 


88.0 


8 


148 


44 


50 


46 


66 


86 


118.5 


88.0 


1 


148 


50 


55 


50 


68 


87 


111.5 


91.5 


5 


187 


12 


19 


68 


70 


88 


102.5 


91.0 


7 


144 


26 


20 


68 


68 


00 


132.0 


123.0 


4 


150 


41 


85 


53 


49 


92 


87.5 


89.5 


9 


150 


21 


12 


64 


57 


98 


100.5 


105.0 


4 


154 


18 


14 


55 


56 


At. 


= 108.8 


98.1 


4.4 


150.8 


82. 


81 


56.1 


57.4 
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2. Deviations and Their Combination 

The next step in calculating the coefficients of correlation was 
to turn all the scores in any one column of Table C into plus 
and minus deviations from the average shown at the foot of that 
column. These deviations are given in Table D. At the foot 
of each column is the square root of the sum of the deviations 
squared, which we shall find to be useful later. Further it will 
be remembered that Visual Vocabulary and the Omnibus tests 
were scored in terms of penalties, and what amounts to the same 
thing, a small measure by Teacher Rank means large excellence. 
To make these tests comparable to the others all their plus de- 
viations were changed to minus and all. their minus deviations to 
plus. 

The reader will notice that two new tests appear in this devia- 
tion table. For reasons to be cbnsidered later it was found 
desirable to combine Visual Vocabulary with Completion. Col- 
tunn I of this new measure is the algebraic sum by individuals of 
the deviations of Visual Vocabulary (i) and Completion (2); 
Column 2 is the sum of Visual Vocabulary (2) and Completion 
(i). The second of these tests or measures is a Composite. 
Column I of this Composite is an algebraic total by individuals 
of all the column I's of all the tests shown in Table E. Column 2 
of the Composite is the same thing for all the column 2's. But 
contrary to the Visual Vocabulary and Completion combination, 
not all the tests in Table E received equal weight. The weight 
actually given to each half of each test is shown under "Weight 
given," ^ in Table E. These weights were guesses, guided by what 
experimental evidence was then available, as to the relative value 
of each test as a measure of mental ability. Now the desired 
weighting was obtained by multiplying or dividing the deviations 
in any one column by the figure under "Multiple" in Table E. 
These figures were those which, when divided or multiplied into 
the square root of the sum of the deviations squared divided by 
ten, changed these square roots to the relative sizes shown under 
"Weight given" in Table E. In psychological literature such a 
Composite is usually taken as a measure of general mental ability. 
^ This weight was given before our own coefficients were calculated. 
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TABLE D 
Deviations fbom the Average of Each Test 



V 



Ind. 


Addition 


Cancelling 2 


Cancelling 8 


Cancelling A 




1 


2 


1 


2 


1 


2 


1 


2 


1 


55.6 


56.8 


38.2 


87.9 


87.9 


40.2 


2.2 


9.0 


2 


— 8.8 


—10.5 


— 7.5 


— 6.0 


— 4.1 


— 6.5 


—10.4 


— 8.9 


8 


24.0 


22.7 


— 1.0 


1.4 


1.9 


— 0.8 


— 5.1 


— 6.4 


4 


—11.1 


—10.5 


—12.5 


—12.8 


—12.1 


—13.7 


— 1.5 


— 2.6 


7 


— 5.0 


— 8.8 


—20.4 


—12.1 


—10.6 


— 9.5 


— 8.7 


— 0.1 


9 


9.4 


9.8 


82.2 


32.4 


17.7 


16.0 


19.5 


20.6 


10 


—87.8 


-37.2 


—29.8 


-30.1 


—23.6 


—16.0 


—13.0 


—10.7 


11 


—28.7 


—82.7 


— 1.8 


7.7 


6.4 


4.7 


— 0.6 


— 0.5 


18 


44.2 


46.7 


30.6 


34.8 


41.9 


42.7 


16.7 


18.8 


14 


24.8 


27.2 


14.0 


14.9 


6.2 


0.7 


6.6 


2.2 


15 


—19.8 


—17.4 


6.6 


1.9 


22.4 


12.2 


36.7 


81.0 


16 


— 0.1 


0.6 


8.5 


10.9 


10.2 


5.6 


4.7 


1.4 


18 


14.8 


15.4 


—12.8 


— 7.6 


—11.8 


—14.8 


1.3 


-0.1 


19 


83.6 


86.5 


— 6.3 


—10.1 


—14.1 


—16.0 


— 8.6 


— 4.8 


20 


10.5 


14.1 


— 4.8 


2.2 


7J 


6.1 


— 5.8 


—10.1 


21 


—28.6 


—22.7 


12.0 


10.2 


4.9 


5.5 


3.6 


1.8 


28 


7.2 


5.7 


0.2 


3.2 


— 0.8 


4.7 


1.6 


— 5.8 


24 


8.7 


8.1 


6.7 


— 1.2 


6.4 


4.2 


18.2 


18.0 


26 


4.0 


1.2 


—16.8 


—12.3 


—16.8 


—13.5 


6.8 


8.4 


27 


10.8 


9.5 


1.0 


9.7 


— 2.6 


— 8.5 


8.2 


11.6 


28 


—26.8 


—26.2 


— 2.3 


— 0.3 


2.2 


5.0 


— 8.8 


—12.1 


29 


—10.9 


—12.7 


24.2 


8.8 


17.4 


18.5 


7.8 


2.0 


80 


6.1 


7.2 


—26.2 


—27.3 


—26.6 


—27.3 


—12.7 


—19.0 


81 


—32.6 


—34.5 


—17.6 


—20.3 


—14.1 


—14.5 


—13.8 


—16.5 


82 


,.— 4.6 


— 6.1 


8.8 


7.7 


7.2 


5.6 


— 3.0 


— 4.8 


85 


-6.9 


— 8.4 


-23.3 


-17.8 


—17.3 


—18.0 


—11.5 


—16.8 


87 


17.5 


21.2 


1.0 


6.3 


1.6 


0.7 


28.2 


32.2 


88 


—26.5 


—27.2 


—17.0 


—19.8 


—18.1 


—19.6 


—10.7 


—18.1 


88 


6.6 


4.0 


—11.0 


—13.8 


— 2.3 


— 7.8 


—10.7 


—10.7 


41 


—11.6 


—11.4 


—16.8 


—19.1 


—22.6 


—27.5 


— 2.1 


— 6.1 


42 


23.1 


26.6 


— 2.2 


— 7.5 


— 1.7 


— 6.0 


2.6 


8.8 


50 


-7.9 


— 7.6 


34.5 


89.2 


28.4 


81.0 


8.0 


8.7 


51 


39.7 


33.7 


—36.2 


—48.1 


—63.6 


—40.0 


— 7.0 


— 1.8 


52 


19.8 


16.6 


-37.8 


-39.8 


-48.6 


—45.5 


—21.8 


-23.6 


54 


8.5 


4.5 


60.7 


41.4 


32.7 


81.1 


3.5 


16.8 


55 


—10.0 


-9.2 


— 6.0 


— 7.6 


0.4 


1.5 


—17.5 


—11.8 


57 


—26.2 


—26.8 


—41.5 


-30.0 


—26.3 


—26.0 


-7.8 


—10.4 


58 


17.4 


21.7 


4.8 


4.9 


0.8 


1.6 


12.9 


14.2 


50 


— 4.2 


— 4.0 


—17.8 


—20.1 


0.7 


2.7 


-12.7 


—11.8 


60 


—28.2 


—23.9 


-12.8 


—18.8 


—16.8 


—24.4 


—10.1 


—18.0 


61 


—20.1 


—20.8 


— 5.6 


1.4 


—11.7 


—18.5 


— 8.8 


— 1.8 


62 


42.1 


46.6 


16.2 


15.4 


13.7 


13.1 


3.6 


8.6 


68 


—15.5 


—21.0 


— 1.3 


4.2 


9.9 


9.5 


12.2 


6.8 


66 


10.1 


10.1 


—12.8 


—15.8 


— 7.6 


-11.8 


—17.8 


—14.7 


67 


0.9 


2.7 


27.7 


29.7 


29.7 


29.5 


— 8.7 


-8.7 


70 


—17.2 


—18.8 


—21.3 


—18.8 


—17.3 


—13.8 


— 1.5 


1.8 


71 


— 2.1 


— 8.9 


6.8 


— 2.1 


4.6 


6.5 


5.7 


0.0 


72 


40.8 


40.6 


3.6 


1.7 


-0.6 


1.5 


— 0.7 


-8.0 


78 


6.5 


— 5.5 


19.1 


21.4 


13.4 


16.7 


1.8 


1.6 


74 


-24.4 


24.6 


— 6.5 


— 6.8 


— 8.8 


—12.8 


— 9.3 


— 7.8 


75 


—17.8 


—21.9 


43.0 


36.4 


26.2 


. 28.7 


23.9 


80.6 


76 


8.4 


6.6 


13.0 


22.2 


12.7 


16.5 


— 2.1 


— 1.0 


78 


— 6.6 


— 7.2 


-17.5 


—12.6 


—18.8 


— 8.8 


—11.0 


—18.0 


80 


46.7 


50.2 


— 2.4 


— 0.1 


— 9.8 


-2.8 


— 0.8 


— 2.8 


82 


— 2.2 


— 1.5 


13.8 


16.7 


16.9 


18.9 


16.5 


16.6 


88 


—13.6 


—14.7 


— 4.9 


— 8.5 


— 1.9 


—10.9 


— 6.1 


— 4.6 


84 


— 7.4 


— 8.4 


36.2 


36.9 


86.9 


86.6 


4.2 


9.8 


86 


—27.2 


—29.9 


2.2 


— 2.8 


2.4 


— 1.8 


6.2 


2.7 


87 


—17.7 


—15.8 


8.2 


6.7 


14.9 


19.0 


— 7.8 


— 1.8 


88 


-20.4 


—21.8 


—17.0 


—18.8 


—27.8 


—22.0 


—10.7 


-18.8 


90 


5.9 


5.6 


84.2 


26.9 


23.0 


26.0 


19.9 


26.4 


92 


— 1.7 


— 2.1 


—10.8 


—12.8 


— 6.1 


— 8.0 


— 9.8 


-10.2 


98 


1.4 
=167.8 


—10.2 
178.8 


-17.8 
159.0 


—21.6 
157.0 


—10.8 
150.0 


— 4.1 
147.2 


18.2 
91.7 


18.0 


5 Dcv.« 


99.6 
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Ind. 


Cancelling S 


Copying Addresses 


Handwriting 




1 


2 


1 


2 


1 


2 


1 


8.0 


8.5 


— 0.2 


— 1.6 


— 0.3 


— 0.4 


2 


—10.5 


— 5.0 


2.7 


5.0 


0.6 


0.5 


8 


—19.2 


—19.0 


— 3.5 


— 1.7 


0.9 


0.2 


4 


0.5 


0.5 


— 5.1 


— 3.8 


— 0.7 


— 0.6 


7 


—22.5 


—80.0 


— 6.8 


— 4.1 


0.0 


0.0 


9 


15.5 


12.0 


1.2 


3.1 


0.9 


0.4 


10 


—11.5 


— 9.7 


— 4.9 


— 8.4 


— 1.2 


— 1.1 


11 


—18.0 


—14.9 


1.6 


6.8 


— 0.8 


— 1.2 


18 


— 1.5 


1.0 


6.0 


8.5 


2.7 


2.4 


U 


12.8 


15.0 


— 2.7 


— 2.8 


— 0.2 


— 0.2 


15 


28.0 


18.0 


— 2.4 


— 0.6 


— 2.0 


— 2.8 


16 


2.8 


5.8 


— 0.8 


0.2 


0.5 


0.1 


18 


— 8.5 


— 3.5 


2.5 


5.3 


— 0.5 


— 0.5 


19 


— 2.5 


—12.5 


— 2.4 


— 0.5 


— 0.2 


— 0.4 


20 


9.3 


12.5 


2.3 


2.8 


0.1 


— 0.4 


21 


15.0 


12.5 


— 6.0 


— 5.8 


— 0.7 


— 0.2 


28 


— 6.5 


1.5 


— 2.4 


— 0.2 


— 0.8 


— 0.8 


24 


81.0 


82.8 


6.5 


10.7 


— 0.4 


— 0.8 


20 


13.0 


10.5 


0.7 


2.5 


— 0.8 


— 0.8 


27 


9.5 


— 0.5 


9.1 


9.4 


1.2 


1.2 


28 


— 8.9 


— 7.0 


— 3.4 


— 1.4 


0.8 


0.8 


29 


11.0 


9.5 


6.8 


9.0 


0.6 


0.5 


80 


-4.0 


— 1.0 


5.7 


5.8 


— 1.8 


— 1.4 


81 


— 2.0 


— 2.5 


— 2.6 


— 3.4 


— 1.7 


— 0.9 


82 


9.0 


1.5 


8.3 


8.6 


1.7 


1.9 


85 


— 7.5 


— 5.5 


1.0 


8.3 


0.8 


0.6 


87 


19.5 


22.0 


1.3 


1.8 


0.8 


0.0 


88 


—10.5 


— 8.5 


— 4.2 


— 3.9 


— 1.8 


— 1.9 


89 


15.0 


16.0 


— 1.3 


0.8 


— 0.3 


— 0.7 


41 


—19.2 


—13.5 


— 0.9 


— 1.1 


0.8 


0.8 


42 


—11.2 


— 3.5 


9.9 


8.2 


1.2 


0.0 


50 


14.3 


21.0 


5.5 


7.4 


1.9 


1.4 


51 


—22.7 


—12.1 


2.0 


3.4 


0.0 


— 0.1 


52 


—20.5 


—21.0 


— 6.1 


— 5.5 


— 1.3 


— 1.3 


54 


—13.5 


— 9.5 


2.8 


3.2 


0.5 


0.8 


55 


—11.0 


—15.5 


— 3.6 


— 0.8 


— 0.9 


— 0.4 


57 


—10.0 


— 5.5 


— 2.4 


— 1.9 


— 1.4 


— 1.8 


58 


6.0 


4.3 


1.7 


8.1 


— 0.2 


— 0.2 


59 


9.5 


11.0 


— 1.7 


— 1.1 


0.6 


— 0.1 


00 


—14.0 


—12.0 


— 0.7 


— 0.8 


0.1 


— 0.1 


61 


8.5 


4.5 


— 5.4 


— 4.2 


— 1.5 


— 1.7 


62 


7.8 


11.0 


3.7 


4.5 


0.6 


0.8 


68 


8.0 


1.5 


— 2.5 


-8.7 


— 1.8 


— 1.0 


66 


5.5 


6.0 


— 4.8 


— 3.2 


0.4 


0.5 


67 


— 2.0 


— 3.2 


— 1.3 


0.0 


1.2 


1.5 


70 


—13.0 


—11.5 


0.1 


2.5 


0.8 


0.8 


71 


3.5 


3.5 


1.5 


0.0 


— 1.2 


— 0.6 


72 


— 9.5 


— 5.0 


0.7 


2.7 


0.4 


0.1 


78 


10.5 


8.7 


— 5.7 


— 4.0 


0.4 


0.3 


74 


5.5 


3.0 


— 2.0 


— 1.1 


— 0.6 


0.1 


75 


26.8 


26.5 


— 1.0 


0.6 


1.5 


1.8 


76 


2.0 


5.0 


10.0 


10.0 


2.7 


2.1 


78 


-17.5 


—10.5 


— 0.8 


0.6 


— 1.1 


— 1.8 


80 


0.0 


— 4.0 


2.1 


8.1 


1.4 


1.1 


82 


—18.0 


— 8.9 


2.2 


4.8 


0.7 


0.7 


88 


11.8 


12.4 


1.2 


2.4 


0.1 


0.7 


84 


0.0 


18.5 


0.1 


2.7 


— 0.4 


— 0.8 


86 


3.5 


2.5 


— 8.7 


— 8.6 


0.2 


0.2 


87 


— 4.5 


0.2 


— 2.8 


— 1.8 


— 0.5 


-0.8 


88 


—11.0 


— 6.0 


— 6.2 


— 4.6 


— 1.1 


— 0.9 


90 


23.5 


29.0 


2.1 


4.8 


0.5 


0.7 


92 


— 3.6 


— 8.8 


2.4 


8.1 


1.7 


1.6 


98 


— 1.5 


— 1.6 


2.1 


8.2 


0.8 


0.5 



^ 5 Dev.* = 99.9 97.6 81.0 83.9 8.36 7.72 
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VUual 



TABLE D (continued) 



Ind. 




Vocabulary 


Completion 


Arithmetic 




1 


2 


1 


2 


1 


2 


1 


^li 3 


- 1.0 


00 


—12.4 


-1.9 


1.4 


2 


- 9.0 


9 


7.0 


1.1 


1.4 


8 


— 8.9 


- 1.0 


— 1 


— 0.4 


1.1 


1.4 


4 


— 8.9 


- 8.4 


— 1 


— 5.4 


— 0.9 


— 1.0 


7 


—13.9 


- 4.4 


1 


— 8.4 


— 0.9 


— 1.0 


9 


— 7.9 + 1.0 


— 8 


— 5.4 


2.1 


1.4 


10 


— 1.9 


- 1.4 


8 


— 4.4 


— 0.9 


— 1.0 


11 


+ 2.1 4- 7.0 


— 4 


2.0 


1.1 


0.4 


18 


— 4.9 


-7.4 


— 8 


-8.4 


1.1 


— 0.0 


14 


+ 8.1 +10.0 


— 8 


— 1.4 


0.1 


0.4 


15 


— 8.9 


-0.4 


— 2 


0.0 


— 1.9 


— 2.0 


16 


+ 5.1 


-0.4 


—11 


— 2.4 


2.1 


— 0.0 


18 


- - 5.1 + 1.0 


— 1 


2.0 


0.1 


— 1.0 


19 


- - 0.1 


-10.4 


— 4 


— 8.4 


0.1 


0.4 


20 


— 0.9 


- 1.4 


00 


1.0 


— 0.9 


0.4 


21 


— 8.9 


-0.4 


-8 


— 1.4 


-1.9 


— 1.0 


28 


+ 1.1 H 
--1.1 


i-4.0 


— 5 


1.0 


1.1 


0.4 


24 


- 1.0 


00 


— 0.4 


— 0.9 


0.4 


20 


— 8.9 


- 1.0 


— 2 


— 0.4 


— 0.9 


0.4 


27 


+12.1 


- 8.0 


18 


10.0 


1.1 


1.4 


28 


ti\ 3 


- 1.0 





— 4.4 


— 1.9 


— 0.0 


20 


-0.4 


— 


1.0 


1.1 


0.4 


80 


+ 0.1 -j 


1-5.0 


— 2 


8.0 


0.1 


— 0.0 


81 


+ 0.1 


- 0.0 


1 


— 1.4 


1.1 


— 0.0 


32 


Ul : 


-0.0 


00 


0.0 


— 1.9 


— 1.0 


85 


-12.0 


17 


11.0 


2.1 


— 0.0 


87 


— 3.9 


-3.4 


00 


0.0 


— 1.9 


— 0.0 


88 


— 2.1 H 


h8.0 


00 


0.0 


2.1 


0.4 


80 


+ 8.1 


- 1.0 


— 1 


0.0 


1.1 


0.4 


41 


+ 8.1 
+ 2.1 


- 5.0 


8 


0.0 


2.1 


0.4 


42 


- 8.0 


00 


8.0 


1.1 


— 0.0 


50 


— 3.9 


-5.4 


— 2 


— 2.4 


— 0.9 


— 2.0 


51 


+ 3.1 H 


h0.0 


8 


2.0 


0.1 


1.4 


52 


— 1.9 


-8.4 


— 8 


0.0 


0.1 


0.4 


54 


—13.9 


-4.4 


— 2 


— 3.4 


-0.9 


— 0.0 


55 


+ 2.1 


hi.o 


— 


— 8.4 


1.1 


0.4 


57 


-2.0 


2 


— 0.4 


1.1 


— 0.0 


58 


— 4.9 


-0.4 


— 2 


— 2.4 


0.1 


— 0.0 


50 


+ 8.1 


-1.4 


2 


4.0 


— 0.9 


— 0.0 


00 


— 1.9 


-10.4 


— 5 


— 9.4 


2.1 


— 1.0 


01 


+ 1.1 


-8.4 


— 1 


— 1.4 


— 1.9 


0.4 


02 


+ 4.1 n 


1-7.0 


8 


7.0 


0.1 


0.4 


08 


— 1.9 


-0.4 


00 


0.0 


— 1.9 


— ao 


00 


+ 0.1 


- 1.4 


-8 


— 1.4 


— 1.9 


— 0.0 


07 


— 2.9 


-7.4 


— 5 


— 4.4 


— 1.9 


— 0.0 


70 


— 5.9 


-5.4 


— 1 


— 2.4 


1.1 


— 0.0 


71 


— 1.9 


-0.4 


1 


0.0 


— 0.9 


0.4 


72 


+ 2.1 H 


h 0.0 


8 


2.0 


8.1 


2.4 


78 


+ 1.1 


-10.4 


— 8 


-9.4 


— 0.9 


0.4 


74 


+ 0.1 


-0.4 


00 


— 4.4 


2.1 


1.4 


75 


-7.9 


-2.4 


— 8 


— 9.4 


1.1 


— 0.0 


70 


+ 2.1 


-1.4 


00 


8.0 


— 0.9 


0.4 


78 


--2.1 H 
--5.1 H 


h 1.0 
- 5.0 


5 


5.0 


1.1 


1.4 


80 


12 


12.0 


2.1 


1.4 


82 


— 0.9 


-7.4 


7 


8.0 


0.1 


— ao 


88 


H 


1-7.1 H 


f- 0.0 





— 1.4 


— 2.9 


— 0.0 


84 


- 


- 5.1 


-1.0 


1 


8.0 


-0.9 


0.4 


80 


4 


-0.1 H 


- 4.0 


— 5 


— 1.4 


— 1.9 


— 0.0 


87 


-3.9 


-8.4 


—11 


8.0 


— 1.9 


1.4 


88 


+ 2.1 


-8.4 


— 1 


— 1.4 


0.1 


1.4 


90 


-4.9 H 


k8.0 
-0.0 


-8 


0.0 


— 1.9 


0.4 


92 


+ 4.1 H 


4 


0.0 


1.1 


0.4 


98 


H 


h 1.1 


-0.4 


1 


— 0.4 


0.1 


1.4 



^ S Dcv.> =89.8 a.9 



42 



4a9 



11.8 



8.56 
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Ind. 



Reading 



Omnibus 
1 



1 


— 4.2 


— 7.6 


—26.7 


2 


4.8 


4.4 


+38.8 


3 


— 2.2 


— 8.6 


— 9.7 


4 


1.8 


— 4.6 


—21.2 


7 


— 6.2 


-15.6 


— 8.7 


9 


3.8 


—15.6 


+ 2.3 


10 


— 3.2 


— 0.6 


+ 1.8 


11 


5.8 


5.4 


-3.2 


13 


— 7.2 


— 5.6 


—10.2 


14 


— 4.2 


— 8.6 


—24.2 


15 


0.8 


— 3.6 


—10.2 


16 


5.8 


0.4 


—26.2 


18 


2.8 


0.4 


+23.3 


19 


0.8 


— 3.6 


+ 2.8 


20 


— 4.2 


1.4 


-5.7 


21 


0.8 


— 0.6 


—34.7 


23 


— 1.2 


5.4 


+24.8 


24 


ZA 


2.4 


-5.7 


26 


— 1.2 


— 6.6 


— 5.2 


27 


6.8 


11.4 


+61.8 


28 


— 0.2 


— 4.4 


—11.7 


29 


— 2.2 


3.4 


—27.2 


30 


0.8 


— 0.6 


+36.3 


81 


1.8 


— 3.6 


—18.2 


32 


— 0.2 


7.4 


+27.3 
+54.3 


35 


5.8 


14.4 


87 


1.8 


— 5.6 


+ 4.8 


38 


— 0.2 


5.4 


-14.2 


39 


— 0.2 


1.4 


+16.3 


41 


— 0.2 


9.4 


+29.3 


42 


0.8 


8.4 


+33.8 


50 


— 3.2 


— 9.6 


— 6.7 


51 


2.8 


3.4 


+28.3 


52 


1.8 


0.4 


— 5.2 


54 


— 4.2 


—12.6 


—29.7 


55 


2.8 


5.4 


+15.3 


57 


4.8 


9.4 


+ 9.3 


58 


— 1.2 


— 1.6 


—28.2 


59 


0.8 


1.4 


+ 5.3 


60 


4.8 


— 3.6 


—18.2 


61 


0.8 


— 3.6 


-41.2 


62 


— 0.2 


7.4 


+25.3 


63 


— 0.2 


— 6.6 


-33.7 


66 


— 0.2 


8.4 


+14.8 


67 


— 1.2 


— 5.6 


-13.7 


70 


— 2.2 


1.4 


—12.7 


71 


0.8 


2.4 


— 6.2 


72 


— 0.2 


2.4 


+33.8 


73 


— 0.2 


— 9.6 


■ -14.7 


74 


1.8 


— 0.6 


-7.2 


75 


— 2.2 


1.4 


—27.2 


76 


— 3.2 


4.4 


—13.7 


78 


— 2.2 


3.4 


+14.8 


80 


— 0.2 


8.4 


+33.8 


82 


1.8 


— 3.6 


+24.8 


83 


— 4.2 


0.4 


— 4.7 


84 


1.8 


0.4 


—10.2 


86 


2.8 


1.4 


—14.7 


87 


— 0.2 


3.4 


— 7.7 


88 


3.8 


5.4 


+ 1.8 


90 


—16.2 


— 4.6 


—28.2 


92 


— 2.2 


6.4 


+16.3 


93 


0.8 


— 4.6 


+ 3.3 



"V S Dev.a = 



28.7 



49.5 



180.0 



—25.9 
+28.6 
—19.9 
—15.9 
—15.9 

— 9.9 
—11.9 
—22.9 
—23.9 
—34.9 
—11.9 
—15.4 
+18.6 
—12.4 
+ 0.1 
—15.4 
+18.1 
+19.1 
—13.9 
+51.6 
+11.6 
—11.9 
+13.6 

— 1.4 
+ 4.6 
--37.1 
--36.1 
-- 2.6 
--15.1 
--49.6 

— 8.9 
—11.9 
+35.1 

— 0.9 
—20.9 

— 6.9 
+28.1 
+ 0.6 
—14.9 
—17.4 

— 3.9 
+30.6 
—12.4 

— 0.9 
—14.4 
+ 1.6 
+ 1.6 
+26.1 
—18.4 
+ 4.1 
—10.9 
—14.4 

— 1.9 
+41.1 
+20.6 
—49.4 
+ 5.1 
-- 5.1 
-- 1.6 
-- 2.1 
—29.9 
+ 3.6 
—11.9 

164.0 



Proverb 

— 2.4 

— 0.4 

— 1.4 
-2.4 

— 2.4 

— 2.4 

— 8.4 

— 0.4 

— 0.4 
1.6 

— 1.4 
0.6 

— 1.4 

— 1.4 

— 1.4 

— 3.4 
0.6 

— 0.4 

— 1.4 
6.6 

— 1.4 
2.6 

— 2.4 

— 1.4 

— 0.4 
6.6 
1.6 
0.6 

— 2.4 
6.6 

— 0.4 
0.6 

— 1.4 

— 0.4 

— 8.4 
0.6 

— 3.4 

— 0.4 
5.6 

— 1.4 
0.6 
0.6 

— 2.4 
0.6 

— 0.4 
0.6 

— 2.4 
4.6 
0.6 

— 0.4 

— 1.4 

— 0.4 

— 2.4 
2.6 
6.6 

— 2.4 
3.6 

— 3.4 
0.6 
2.6 

— 0.4 
4.6 

— 0.4 

20.7 



Age in 
months 

4.7 
2.7 

— 5.3 
2.7 
5.7 
0.7 

12.7 

2.7 

—14.8 

— 2.8 
—16.3 

15.7 

—13.3 

14.7 

— 6.3 
—11.3 

— 5.3 

— 7.3 
31.7 

—11.8 
4.7 
8.7 

— 0.3 
1.7 

11.7 
13.7 
10.7 

— 8.3 

— 0.3 
3.7 
3.3 

— 4.3 
—10.3 

— 0.3 
12.7 

2.7 

— 8.3 
—15.3 

9.7 

15.7 

—13.8 

11.7 

5.7 

3.7 

4.7 

—17.3 

—10.3 

0.3 

29.7 

— 8.3 
7.7 
0.7 

—10.3 

— 8.3 
—18.3 

4.7 

— 7.3 

— 2.3 
—13.3 

— 6.3 

— 0.3 

— 0.3 
3.7 

82.6 



Teacher Rank 


1 


2 


—10 


— 9 


+ 2 


+ » 


+10 





—21 


—22 


—28 


—26 


+ 7 


+17 


+ 


+•* 


+ 4 


—10 


— 6 


— 5 


-29 


-80 


+ 1 


— 4 


—20 


—27 


+23 


+.« 


—25 


—20 


—17 


-19 


—16 


—17 


+12 


+w 


+25 


+23 


-26 


—28 


+31 


+? 


-80 


—24 


+17 


+11 


+ ? 


+ 2 


— 3 


— 2 


—11 


—16 


+29 


+28 


+ » 


+10 


— 8 


+ 6 


+19 


+ 4 


+30 


+81 


+15 


+14 


-15 


—11 


+21 


+25 


+ 5 


+ 7 


-41 


-41 


—14 


+ 1 


+ 3 


-12 


+26 


+22 


-2 


+ 8 


—24 


-18 


— 1 


— 7 


+22 


+27 


-19 


—29 


— 7 


— 8 


—28 


-25 


+13 


— 1 


— 5 


—15 


+18 


+26 


—27 


—14 


+24 


+21 


—13 


— 6 


— 4 


+18 


+16 


+15 


+27 


+30 


+28 


+24 


-22 


—21 


—12 


—18 


—18 


—23 


+20 


+18 


+ S 


+12 


— 9 


— 8 


+11 


+20 


+14 


+18 



144.3 



144.8 
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TABLE D {continued) 
Ind. School Mark 

1 



Ms 



1 


—10.0 


3 


— 1.1 


S 


— 1.1 


4 


—18.1 


7 


-15.1 


9 


4.9 


10 


4.9 


11 


— 7.1 


IS 


— 0.1 


14 


—18.1 


15 


3.9 


16 


—18.1 


18 


11.9 


19 


-lai 


SO 


0.9 


31 


—17.1 


38 


10.9 


34 


19.9 


36 


— 8.1 


37 


17.9 


38 


—14.1 


39 


3.9 


SO 


0.9 


31 


— 6.1 


S3 


—15.1 


35 


11.9 


37 


1.9 


88 


8.9 


89 


0.9 


41 


19.9 


43 


5.9 


50 


— 1.1 


51 


17.9 


63 


-8.9 


54 


—20.1 


55 


— 9.1 


57 


2.9 


58 


35.9 


59 


— 3.1 


60 


—19.1 


61 


— 1.1 


63 


12.9 


68 


-6.1 


66 


5.9 


67 


—13.1 


70 


1.9 


71 


1.9 


73 


13.9 


78 


—15.1 


74 


9.9 


75 


— 5.1 


76 


1.9 


78 


10.9 


80 


16.9 


83 


16.9 


88 


—17.1 


84 


—10.1 


86 


— 6.1 


87 


11.9 


88 


6.9 


90 


— 4.1 


93 


7.9 


98 


— 1.1 



k 


Composite 


Visual Vocabulary 








•^Completion 


3 


1 


3 


1 


8 


-9.4 


-S1.8 


—46.8 


— 8.8 


1.6 


0.6 


80.3 


83.3 


9.5 


18.6 


-6.4 


—15.4 


—40.8 


—15.8 


0.6 


-16.4 


-68.3 


—96.4 


— 9.8 


— 4.4 


-12.4 


-88.8 


—115.1 


—17.8 


— 8.4 


-6.4 


88.7 


-20.8 


—18.8 


— 1.4 


-8.4 


-14.6 


—72.1 


-6.8 


6.6 


- 1.4 


— 5.8 


— 2.5 


4.7 


8.6 


- 1.4 


1.8 


—23.1 


— 8.8 


—10.4 


36.4 


-59.3 


-66.9 


1.7 


18.6 


3.6 


—35.3 


-35.3 


— 8.8 


-8.4 


-10.4 


—49.4 


—45.7 


3.7 


—11.4 


13.6 


56.0 


87.7 


7.7 


0.6 


-14.4 


—38.5 


-61.5 


— 8.8 


—14.4 


8.6 


—38.5 


16.8 


0.7 


— 1.4 


-10.4 


-91.1 


-64.0 


-5.8 


— 9.4 


6.6 


82.4 


59.5 


3.7 


— 0.4 


14.6 


47.8 


77.1 


0.7 


1.6 


-16.4 


—46.5 


—52.5 


— 4.8 


— 0.4 


10.6 


188.6 


184.8 


38.7 


31.6 


- 5.4 


-48.7 


—41.9 


— 1.8 


7.6 


-5.4 


—10.2 


16.3 


4.7 


— 6.4 


-8.4 


81.8 


14.3 


8.7 


8.6 


-11.4 


—24.6 


-^2.2 


4.7 


1.6 


-2.4 


— 0.8 


2.9 


2.7 


0.6 


14.6 


158.5 


127.0 


32.7 


39.6 


0.6 


11.4 


48.6 


-8.8 


— 8.4 


-8.4 


—22.0 


2.3 


— 1.5 


8.6 


8.6 


83.5 


28.1 


8.7 


0.6 


18.6 


96.8 


113.9 


14.7 


18.6 


-0.4 


73.0 


36.0 


5.7 


8.6 


7.6 


—19.2 


—87.0 


-6.8 


— 7.4 


11.6 


78.5 


88.1 


5.7 


14.6 


-7.6 


—26.1 


—19.7 


-1.8 


—11.4 


-13.4 


—82.5 


—74.3 


—37.8 


— 6.4 


-11.4 


-15.3 


-32.3 


— 1.8 


— 4.4 


8.6 


14.3 


23.5 


1.7 


4.6 


10.6 


9.3 


30.1 


-7.8 


— 3.4 


1.6 


— 1.3 


— 7.2 


7.7 


0.6 


-6.4 


—56.9 


—106.4 


—11.8 


—15.4 


0.6 


—72.1 


-30.6 


— 0.8 


— 4.4 


15.6 


84.8 


182.6 


11.7 


10.6 


-6.4 


-68.5 


-60.8 


— 1.8 


— 6.4 


-0.4 


—15.8 


— 6.8 


— 1.8 


— 4.4 


-7.4 


-65.6 


-60.7 


— 7.8 


—13.4 


8.6 


—38.7 


—16.2 


— 8.8 


— 6.4 


- 1.4 


— 6.3 


2.7 


— 1.8 


0.6 


11.6 


115.7 


95.0 


4.7 


8.6 


-18.4 


—72.3 


-94.2 


— 8.8 


—18.4 


-4.4 


9.7 


— 5.8 


— 4.8 


— 0.4 


■ 7.4 


—47.8 


—84.6 


-17.8 


—10.4 


- 1.4 


— 9.8 


83.8 


5.7 


— 1.4 


12.6 


41.8 


44.5 


7.7 


6.6 


19.6 


183.0 


160.9 


17.7 


17.6 


18.6 


87.6 


55.4 


3.7 


— 0.4 


-4.4 


—41.7 


—75.4 


5.7 


6.6 


8.6 


— 8.6 


40.8 


8.7 


3.6 


5.6 


-63.0 


—18.8 


— 1.8 


— 0.4 


13.6 


—43.8 


40.5 


— 0.8 


—19.4 


10.6 


-5.9 


12.0 


0.7 


— 4.4 


8.4 


-89.6 


—12.5 


-4.8 


— 4.4 


0.4 


46.3 


51.8 


10.7 


10.6 


-1.4 


14.8 


-21.6 


-5.8 


6.6 
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TABLE E 
Weights Given to Each Test in Evolving a Compositb Measure 



Multiple = 


the number by which the deviations of the tests 


to the 


left were multiplied or 


divided to secure the desired weighting. 








Sq. root of Sum Dev." 






Weight 








Divided by 10* 


Multiple 




Given 


Addition 




I 


16.73 -i 


4 


— 


4.2 


u 




2 


17.38 H 


4 


= 


4.3 


Cancelling 2 




I 


15.90 


r 5 


^z 


3.2 


« 




2 


15.70 


r 5 


= 


3.1 


Cancelling 3 




I 


1500 


i- 5 


^^ 


3.0 


« 




2 


14.72 


'- 5 


r^M 


2.9 


Cancelling A 




I 


9.17 


i- 5 


nz 


1.8 


it 




2 


9.96 


'' 5 


^^* 


2.0 


Cancelling S 




I 


9.99 


'r- 5 


=. 


2.0 


a 




2 


9.76 


'r- 5 


33 


2.0 


Copjring Addresses 


I 


3.10 X I 


~^ 


3.1 


u u 




2 


3.39 X I 


^~ 


3.4 


Visual Vocabulary 


I 


3.98 X I 


= 


4.0 


l< u 




2 


4.39 X I 


^^* 


4.4 


Completion 




I 


4.29 X 3 


^^ 


12.9 


n 




2 


4.09 X 3 ' 


^"^ 


12.3 


Arithmetic 




I 


1.13 X 8 


= 


9.0 


u 




2 


0.86 X 8 


— ^ 


6.9 


Reading 




I 


2.87 X 2 


^^ 


5.7 


u 




2 


4.95 X 2 


^ 


9.9 


Omnibus 




I 


18.00 X I 


1= 


18.0 


u 




2 


16.45 X I 


=: 


16.5 


Teacher Rank 




I 


14.43 H 


2 


"•^ 


7.2 


it 




2 


14.43 -' 


2 


^^ 


7.2 


School Mark 




I 


S,72 X I 


~ 


8.7 


i< 




2 


_ 8.03 X I 


^^ 


8.0 



*This figure has no special significance. 

3. Calculation of Raw Coefficients of Correlation 

A coefficient of correlation is a numerical statement of the 
proportionality between two series of measures. If the excel- 
lence of the scores made by a number of individuals in one test 
is exactly proportional to the excellence attained by the same in- 
dividuals in another test, the correlation is positive and perfect. 
Using r as an abbreviation for correlation : r = -\-i. If the pro- 
portionality is exactly inverse, r = — i. If there is no tendency 
to proportionality at all, r = o. If there is a tendency to pro- 
portionality r is either a positive or negative decimal according 
to the direction of the tendency. 

The standard method ^ has been used in calculating all the co- 
efficients of correlation. This method is expressed by the Pearson 
formula : 

*The Bravais-Galton-Pearson method. 
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Referring to Table D the method of calculating the r for, say. 
Addition (i) and Cancelling 2(1) was, viz.: The deviations in 
the Addition (i) column were considered x's while the devia- 
tions in the other column were ^^'s. The numerator of the for- 
mula was obtained by getting an algebraic sum of the products of 
every x multiplied by its corresponding y. The figures at the foot 
of the two columns being correlated were the denominators of 
the formula. Given these, r was easily calculated. By employ- 
ing this method the first measure of every test was correlated with 
its second measure; some measure of every test was correlated 
with some measure of every other test ; in certain instances, every 
column of a few tests was correlated with every other column 
of certain other tests. These first coefficients are called raw 
coefficients. 

4. Calculation of Corrected Coefficients of Correlation 

Thanks to the excellent work of Spearman, we now know 
that these raw coefficients are not true representations of the pro- 
portionality between measures or functions. He discovered that 
chance inaccuracies in the original scores did not balance them- 
selves out but that they always tended to reduce the correlation 
toward zero.^ The correlation was said to be "attenuated." The 
next step in this study was to correct the raw coefficients for at- 
tenuation. There was used for this purpose Spearman's for- 
mula : 



y(^PiQi) (^Piffa) (^P2Ql) (^P2q2) 

rpq = 

^(^PlP2) (^QlQ2) 

where, if A and B are the facts to be related, /> is a series of exact 
measures of A, ^ is a related series of exact measures of B. 
rpq is the coefficient of correlation of A and B, obtainable from 
the two series p and q, thus being the true coefficient, p^ and p2 
are two independent series of measures of A. ^i and q^ are two 
independent series of measures of B. rp^q^ is the correlation 
when the first measure of A and the first measure of B are 
used. rpiQa is the correlation when the first measure of A and 
the second measure of B are used and so on for the remaining 

^ For a criticism of Spearman's assumption see Brown, The Essen- 
tials of Mental Measurement. 
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symbols. It is now clear why two measures for each individual 
in every test were necessary. Without two measures the raw 
coefficient is the best measure obtainable. 

The raw intercorrelations among all the tests (except the prac- 
tice tests) for which there were double measures, were calculated 
for every column with every other column in that group. This 
group also included the Composite. These raw coefficients sup- 
plied all the necessary data for calculating the true coefficients 
from the Spearman formula. Now the practice tests gave much 
more reliable measures for each individual; hence, whenever a 
practice test was being correlated with any other test just enough 
coefficients were calculated to satisfy the shorter correction for- 
mula: 

^(^P^gl) (^P2g2) 

A/(rpiP2) (U1Q2) 

By the use of either of these two formulas the corrected coefficient 
or the true correlation was found for every test or function 
which was measured twice. The Age of Reaching the Grade, 
while really one measure, was treated as though split exactly in 
two, r^iffg ill the shorter formula thus being considered as -f- ^• 
This left only one test uncorrected. Table F gives the corrected 
coefficients or the true correlations between the tests and the 
functions which they measured. A gap in the table means that 
the true coefficient is substantially zero. The correction at that 
place was impossible either because one of the raw coefficients 
turned out zero or because one was a small positive and the other 
a small negative. In either of these cases the correction for- 
mula fails to work. 

The shorter correction formula above is the same as the 
longer formula except that two symbols have been omitted from 
the numerator. Theoretically, it would have been better to have 
retained the omitted and omitted the retained symbols, but, prac- 
tically, the difference in correction is insignificant. The longer 
formula is to be preferred but the time required often makes its 
use prohibitive. 



32 Correlation of Psychological and Educational Measurements 



II -^1 

siJtiK Iooi{3s s^S^S; 8^ 8IS9SS2SS S 

• I r I r • • 

'11' I r ' ' 



I' 1" !' r !' I' r 



.• • •• • 



snqiuuio ^-^jsaa {3SS& 8RI28 

* r r r I r ' '-^ 



p 



I r r I' I 



MM 



I 



fa 

2 



O 

CO 

H 



O 



uopjidujoo •58J8S52S2S !5lf!8S5RR8 

* I* M' I r * ' * 

iLiBinqcooA l«nsiA S:§88S; c3S S8SSS 9S83 

' I' I* I 



anpuMpuBH ;S9$^SSS 8S 



8 n 



•Mswppv suixdoo fcS8sa S8SSS aass5S 
s8uiiiaDUB3 sggs as 2s5aas;38 

r I* r I* ' I' I' 

vauHpouBO 2gg S8SS5S5a8SS 

I' I* r I' I' r 

I* I* I* r I' ' r I* I* 

r I* r r I' i* r r 



r ' r ' * ' 



: w 

• to 

• CO 

u 






«« 













Statistical Treatment of Results 33 

5. Reliability Coefficients 

The significance of the corrected r's shown in Table F is de- 
pendent on their reliability. This reliability is in turn dependent 
on the number of subjects used and the amount of correction 
that has been applied. The "reliability coefficient" or the raw r 
for two separate measures of any one test indicates the amount 
of this correction. The corrected r for two tests whose reliability 
coefficients are exceedingly small is of doubtful value. Some 
of the ^factors ^ which make for high reliability coefficients are : 
that the function tested be narrow; that the time spent in test- 
ing be long; that the test material and experimental technique 
for the two tests be identical ; and that there be no large variation 
in the condition of the subjects. The reliability coefficient for 
every test having a double measure is shown in the table of raw 
coefficients further on in this book, but for convenience they 
are summarized below. 

TABLE G 

Reliability Coefficients, together with the Total Time Spent on the 
Test or Tests Composing -either One of the TW9 Correlated 

Measures 

Addition, 100 minutes (10 tests) 99 

Cancelling 2, 8 minutes (8 tests) 97 

Cancelling 3, 8 minutes (8 tests) 96 

Cancelling A, 7 minutes (7 tests) 95 

Cancelling S, 4 minutes (4 tests) 93 

Copjring Addresses, 100 minutes (10 tests) 92 

Handwriting, 40 minutes (10 tests) 94 

Visual Vocabulary, 30 or less minutes (i test) 53 

Completion, 30 or less minutes (i test) 59 

Arithmetic, 30 or less minutes (i test) 41 

Reading, 30 or less minutes (i test) 37 

Omnibus, 60 or less minutes (2 tests) 71 

School Mark, i semester 83 

Teacher Rank 92 

Composite 89 

The very, very high reliability of the tests from Addition 
through Handwriting is due chiefly to the narrowness of the 
functions tested, the similarity of the test material and also, in 
the case of Copying Addresses and Addition, to the relatively 
large amount of time spent on the tests. Intercorrelation among 
these tests scarcely needed correction. The reliability of Arith- 
^ These factors do not grow out of our data. 
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metic and Reading is unsatisfactory; that of Visual Vocabulary 
and Completion leaves something to be desired; all the rest are 
satisfactory. The coefficient for Teacher Rank is surprisingly 
large, due probably to the close cooperation of. the two teachers 
in teaching the same children. So, with regard to reliability, the 
only corrected coefficients which need to be closely scrutinized 
are those with Arithmetic and Reading. 

We have spoken of the reliability of the tests as dependent 
on the amount of the correction. It is important to know the 
reliability of any particular coefficient derived from these tests. 
This is dependent on the number of cases or the number of 
individuals. P. E. is the measure of this reliability according to 
the formula: 

PE. = ^745(1-^^) 



\n 

where r = actual coefficient of correlation and 

n = number of cases included. If the number of cases were 
infinite the reliability would be absolute. We have always used 
sixty-three cases, hence 

.67 (i — r^) 
P. E. = - 



>|63 
Using this formula we get: 

Probable Error of the Coefficients of Correlation 

r P. E. 

.1 .08 

.2 .08 

.3 .08 

.4 .07 

.5 .06 

.6 .05 

.7 .04 

.8 .03 

.9 .02 



IV 

CONSIDERATION OF PROBLEMS AND COMPARISON 
OF RESULTS WITH THOSE OF OTHER EX- 
PERIMENTERS 

1. What Are the Intercorrelations among Some Recent 

Educational and Vocational Measurements and Cer- 
tain Traditional Tests? 

The first problem which this study set out to attack has now 
been solved. The corrected coefficients given in Table F are 
the answer. Since these correlations will be considered in con- 
nection with other problems, a detailed discussion at this place 
would be tedious. In interpreting the corrected r's the reader 
should remember one fact in addition to the cautions given 
in the preceding chapter. Handwriting was scored by amount 
copied and no attention was given to the quality of the penman- 
ship. A large score in this test might mean that the quality of 
the writing had been sacrificed. On the other hand, it might 
be contended, from a study of the penmanship of men of great 
ability, that increased speed and decreased quality both correlate 
very highly with mental power. With no evidence to oflfer, the 
author prefers to leave the matter to the opinion of the reader. 

2. What Is the Order of Each Test's Correlation with 

Mental Ability? 

Before this problem can be solved we must have some measure 
of mental ability. This study proposes three different standards 
by which to measure each test. 

The first standard includes all the available measures which 
are outside our psychological tests. The ideal standard would 
be one which properly weighted all the activities in the life of an 
individual. A complete standard would take into account not 

35 
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only how well one does in a psychological test but also what kind 
of grade is made in school, what kind of opinion the teachers 
have, how well the games of ball are played, the papers sold, the 
errands run, etc. Of all these things there are, outside the 
psychological tests, just two measures available: Teacher Rank 
and School Mark. The value of these two measures as one of 
our standards consists in the fact that they represent an at- 
tempted weighting of numerous activities, and that they are 
measures free from any preconceived opinions of this study. The 
corrected r's in Table F for Teacher Rank and School Mark 
have been averaged for each test, and the positive size of this 
average has been taken as that test's correlation with mental 
ability. 

The second standard used is the correlation of each test with 
the Composite. The Composite combines the standard just de- 
scribed with the psychological tests. Possibly the Composite 
gives too much weight to the Cancellation tests but, in view of the 
later discussions of this book, it is perhaps wiser to err in this 
direction. All considered, the writer believes this to be the best 
measure of mental ability available for this study. 

The third standard by which to determine the value of a test 
as a measure of mental ability is the average of that test's corre- 
lations with all the other tests. But immediately we get into a 
difficulty, a difficulty which was minimized in connection with 
the .use of the Composite as a standard. A glance at Table F 
will show that there are at least two distinct groups of tests which 
oppose each other: the Cancellation group and the group rep- 
resented by the Complex tests. In evolving the Composite meas- 
ure, this difficulty was surmounted by arbitrarily giving a rela- 
tively small weight to the Cancellation tests. But with the third 
standard where equal weight is given to each correlation the Can- 
cellation group will exert an important influence. Obviously, it 
would not be fair to give as much weight to five Cancellation 
tests as to five other separate tests, especially when the Cancella- 
tion group measures such a narrow function. If there were just 
one such test the matter would not be so serious. If the Can- 
cellation tests are good measures of mental ability then the 
Complex tests are not. In this dilemma our first standard proves 
its worth. Teacher Rank and School Mark, admitted by all 
experimenters to have considerable value as measures of men- 
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tal ability, vote against the Cancellation group. Further, com- 
mon sense shows that the other group measures a wider range 
of abilities. Moreover, any one test in the Complex group shows 
a wider range of positive correlation. Consequently, no test will 
be used for the third standard that does not show a distinct 
positive correlation with the first standard. This eliminates Age, 
Handwriting, and the Cancellation tests. 

Using these three standards the order of each test's correla- 
tion with mental ability is shown in Table H. 

TABLE H 

Order of Correlation of Each Test with Mental Ability by Stand- 
ards I, 2 AND 3 AND BY AN AVERAGE OF THE ThREE. (Data ffOm 

Table F) 

Teacher Rank and 

School Mark Composite All other tests Average 



Omnibus 


75 


1. 00 


.66 


.80 


Completion 


.73 


.96 


.64 


.78 


Teacher Rank 




.86 


.63 


.75 


School Mark 




.91 


.54 


.73 


Reading 


.68 


.81 


.53 


.67 


Arithmetic 


.62 


.72 


.49 


.61 


Visual Vocabulary 


.44 


.80 


.56 


.60 


Copjring Addresses 


.34 


.54 


.29 


.39 


Addition 


.23 


.37 


.20 


'27 


Handwriting 


.02 


.22 


.13 


.12 


Cancelling A 


.00 


.00 


—.08 


—.03 


Cancelling S 


—.10 


.00 


—.09 


— .06 


Cancelling 2 


—.28 


—.18 


—.23 


—.23 


Cancelling 3 


--.28 


—.18 


—.24 


—.23 


Age 


—.50 


—.26 


—.19 


—.25 



In studying Table H it is important that the reader remember 
that a coefficient of correlation from arrays of averages is not 
necessarily the same thing as an average of several coefficients 
of correlation. An example of the former are the coefficients 
in the column under Composite, while an example of the latter 
are the coefficients in the other three columns. But our problem 
is not now to discover the absolute coefficient of correlation be- 
tween any one test and mental ability; it is to rank the tests 
relatively, i.e., which test correlates most closely, which second, 
which third, etc. Each of the three standards should give sub- 
stantially the same ranking to each test. In fact, the agreement 
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is remarkable. The average of the ranking by the three standards 
is practically the same as the ranking by any one of the standards. 
This average can be taken as the answer to our problem. 

3. How Close Is the Correlation of Each Test with 

Mental Ability? 

The answer to the above problem depends upon which standard 
is accepted as the best measure of mental ability. Omnibus cor- 
relates .75 with Standard i, i.oo with Standard 2, and .66 with 
Standard 3. Which is the truest coefficient? To trust to an 
average of the three, as was done in section 2, would merely 
serve to conceal glaring differences. The Composite is better 
than Standard i because it includes Standard i along with many 
other valuable measures. Standard 3 or the correlation of each 
test with all others gives an equal weight to all the measures 
composing it, but all three standards agree that all the tests do 
not equally measure mental ability. The Composite gives a 
weighting which is, at least, roughly correct. Strictly speaking, 
the correlation of a test with all other tests taken separately is 
a measure of a test's correlational spread rather than an absolute 
measure of its closeness of correlation with all these separate 
abilities considered together. So far as the question under con- 
sideration goes, Standard 3 assumes that, disregarding chance 
errors in measurement, any one test is as good a measure of 
mental ability as any other and that any one test is as good as 
all averaged together. The Composite, on the other hand, con- 
siders a sum of properly weighted abilities a better measure of 
mental ability than any one of them taken separately. For 
these reasons this study considers the Composite the best avail- 
able measure for determining the absolute correlation between 
any one test and mental ability. 

Since we are hopelessly immersed in theory, we may as well 
consider the most important objection likely to be offered to the 
Composite. It might be said that the Composite causes a test 
to show a spuriously high correlation with mental ability because 
it is composed of the tests which are to be correlated with it. On 
the contrary it might be argued that to eliminate Completion, 
say, from the Composite before correlating it with the Composite 
would unfairly reduce the correlation, for mental ability means 
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the ability to do Completion as well as the ability to do the 
thousand and one other things which enter into complete living. 
To strike a true balance between these two contentions would be 
difficult ^ if not impossible, consequently the Composite has been 
retained in its original form. 

Using, then, the Composite as a standard, the closeness of the 
correlation of each test with mental ability is shown in column 
2 of Table H. This column reveals five interesting facts : 

a. Omnibus and Completion correlate perfectly with mental 
ability. To be exact, Completion correlates +.96. 

b. Seven of the tests correlate closely with mental ability. 

c. The Cancellation tests give a negative correlation with men- 
tal ability. 

d. The Age of Reaching the Grade also correlates negatively 
with mental ability. 

e. The coefficients for the tests which measure power are in 
every case larger than the coefficients for the tests which measure 
speed. 

4. What Is the Practical Significance of These Facts 
FOR Educational and Vocational Diagnosis and 

Guidance ? 

Before considering each of the above facts in the light of the 
problem just stated it is interesting to consider another question : 
just what is the need for measuring mental ability ? The pseudo- 
philosopher derives his greatest pleasure from discoursing upon 
the negative correlation which exists between the academic and 
the real world. In one respect at least this antagonism no longer 
exists. The most persistent demand that has come to the psychoC- 
ogist in the last few years has been, that he develop a means for 
measuring that most elusive yet pre-eminently valuable thing 
which we call mental ability. And this call comes from school 
and factory alike. 

The school wants to adjust its training to the individual differ- 
ences of the pupils. How can it measure these differences, is the 
question asked of the psychologist. The principal wishes to class- 
ify a group of children by ability. How measure the ability? 
The junior high school wishes to put in one group the supernormal 

1 There is a statistical method by which the amount of spurious cor- 
relation can be determined. 
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pupils, in another group the normal, and in another the subnor- 
mal. How be certain the pupil is not wrongly placed ? Educators 
realize that some pupils simply haven't the ability to deal with 
mental elements, abstract symbols and the like. Which pupils? 
A class for mentally defective children is being formed. Who 
should be in the class ? A college in the West is planning to select 
its Freshman class on the basis of mental tests. Are the tests 
valid measures of mental ability? Experimenters everywhere 
wish to form groups of equal ability. By what standard shall 
they be called equal ? Sociologists wish to discover if unemploy- 
ment is the result of mental defectiveness. How gauge the men- 
tality? Makers of mental tests desire a standard by which to 
measure their own product. What standard is reliable? The 
youthful yet virile science of vocational guidance wants to pre- 
vent or diminish the present fearful misdirection of energy. 
Business is little less clamorous, but no more need be said to 
show the very great importance of discovering excellent measures 
of general ability as well as tests for special powers. Now let 
us return to the significance of the facts reported in the last 
section. The first of these was : 

(a) The Omnibus and Completion Tests Correlate Perfectly 

with Mental Ability 

The problem of measuring every single activity of an individual 
in order to determine his general mental ability, is, of course, 
impossible of solution. So psychology has been trying to find 
a few measures which epitomize all possible measures. So far 
as the writer is informed, the test which has received the most 
favorable mention in this connection has been the Ebbinghaus 
Mutilated Text. The Completion Test, mentioned above, is a 
development by Dr. Trabue of Ebbinghaus' idea. This study 
finds ample justification for the high favor accredited the Eb- 
binghaus Test and it congratulates Dr. Trabue upon a modification 
of it which is likely to prove still more valuable. If we remem- 
ber that mental ability means mental ability as measured by our 
Composite, the Completion Test correlates with it -}- .96. The 
correlation is not exactly perfect but it is very nearly so. 

This study is equally pleased to congratulate Dr. Thomdikc 
upon having compiled and in part devised the Omnibus Test 
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which correlates + 1.00 with our Composite. The Completion 
Test was given for thirty minutes, the Omnibus for sixty minutes. 
Does this correlation of -}- i.oo mean that a test has at last been 
devised which gives a perfect measure of an intellect by one hour 
of testing? It must not be forgotten that the + i. 00 is a cor- 
rected coefficient. Were the i.oo a raw coefficient and were the 
Composite adequate the above question could be given an affirma- 
tive answer. The corrected coefficient -}- i.oo means that were 
an individual measured enough times with the Omnibus Test to 
be certain of an accurate score, then that individual would have as 
perfect a measure as if he had been given all the tests compos- 
ing the Composite. How many times and how long each time a 
person would have to be tested in order to give a perfect ^ meas- 
ure of him in any one function is for a future research to deter- 
mine. But granting the Composite is not an adequate measure 
of mental ability and granting the correction is a little too large, 
the fact remains that the Completion Test and Omnibus Test are* 
very excellent ones. But because of the multiplicity of mental 
functions and the variability of their performances it is wise 
to give several types of tests and possibly to secure several 
measures for each type. This brings us to the second significant 
fact mentioned a few pages back : 

(b) Seven of the Tests Correlate Closely with Mental Ability 

Since it is wiser to trust to several tests than to one or two, 
those interested in educational and vocational diagnosis, guid- 
ance, and classification as well as vocational selection will want 
advice as to what tests this study would recommend. Of the 
fourteen measures used, we consider the following to be the 
best and most reliable indices of intellect : Omnibus, Completion, 
Visual Vocabulary, Teacher Rank, School Mark, Reading and 
Arithmetic. The first five tests are the best. An average from 
them will give a good measure of an individual's ability, and that 
with the expenditure of just two hours in actual testing. The 
difficulty of the purely psychological tests could be varied to 
suit the ability of the group being tested. It ought not be long 
until other tests are devised which can be added to this small 
group. It is not too much to hope that the near future ,will 

^This term is used loosely, for psychology is far from agreement as 
to what constitutes a perfect measure. 
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find psychologists able to measure general mental ability very 
accurately for a group of any size after one day of testing. 
Until that time comes we now have tests which will measure in- 
tellect roughly at least. And for many purposes such a rough 
measure will suffice. 

To the five measures recommended in the preceding paragraph 
three criticisms suggest themselves. In the first place, Teacher 
Rank and School Mark are not always available. Or in cases 
where they are available, it is often impossible to use them because 
Teacher Rank is not an absolute measurement and because School 
Mark varies in meaning even within one school. In the second 
place, the psychological tests recommended, measure, primarily, 
abstract ability — ^the ability to handle ideas and symbols rather 
than to deal with "things and their mechanisms." All that we 
know ^ about the relation between Idea Thinkers and Thing 
Thinkers indicates that the man who is good at manipulating 
ideas is potentially good in manipulating things. If the mechani- 
cal skill desired requires special training this criticism is more 
serious. The third criticism is that such tests as these can only 
be given to literate people. This is true but it is a fault which 
our schools are repairing every day. These three criticisms 
merely limit the usefulness of these measures and they emphasize 
the fact that even psychological testing requires the exercise of 
common sense. 

Another result of this study which may prove of practical 
value is : 

(c) The Age of Reaching the Grade Correlates Negatively with 

Mental Ability 

Probably every text-book on the psychology of individual dif- 
ferences mentions maturity as an important factor in producing 
differences in mental ability. But no educational administrator 
now believes that mental age always coincides with chronological 
age. If he does so believe, he does not dare use it as the sole 
basis for the classification of the school children. A very com- 
mon complaint among young teachers is that their chronological 
age weighs heavier than their mental age with school superin- 
tendents. Besides these immediately practical significances, the 

^We greatly need tests of mechanical ability to experimentally test 
this statement. 
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influence of age is of keen concern to almost everyone who is 
engaged in educational or psychological research. Correlational 
psychology, for example, is in constant fear lest its insidious 
influence operate to produce spurious correlation. To be brief, 
no one would object to this statement: below the age where 
senility begins, the tendency is for the older individuals to be 
the more able. In so far as the two sixth grades studied here 
are typical of all grades, we find an exactly opposite tendency, 
which may be summarized, vis,: in » any one class the tendency is 
for the more mature to be the less able. This is no rank heresy 
nor is it an unpredictable mystery. If a pupil is overage for his 
group it probably means that he has been retarded, and this in 
turn probably means that he started life with ah intellectual 
capacity which could be expressed as a minus deviation from the 
average. So the influence of maturity is not a simple one, or to 
speak more exactly, age is no sure criterion of mental ability. 
The meaning of age is dependent upon the group in question. 
The scope of the negative correlation found in this study needs 
to be tested by experiments upon other grades and other groups. 
Even more important is the next fact growing out of this re- 
search : 

(d) The Cancellation Tests Show a Negative Correlation with 

Mental Ability 

We say above that Cancellation correlates negatively with the 
Composite. The zeros after Cancelling A and Cancelling S 
(Table H) mean that in those two cases the correction formulas 
could not be applied. In addition to the evidence of Table H 
the trustworthiness of the negative correlation is further certified 
to by the fact that the Cancellation tests correlated negatively with 
each of the seven tests which have shown themselves to be good 
measures of mental ability. The coefficients are small but dis- 
tinct. 

It is beyond the scope and data of this research to consider 
why, so far as psychology is concerned, there has been such 
a chasm between laboratory and life. We suggest that possibly 
we have here, in the negative correlation of Cancellation with the 
Composite, one element of a complete explanation. The Can- 
cellation Test is a not unfair sample of what traditional psychology 
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has been employing in its laboratories. In order that positively 
interpreted results from such a psychological test correspond 
to results from practical experience, what is would have to coin- 
cide with what tends not to be. But a problem of such magnitude 
cannot be settled by the relatively meagre data of this study. 

The point of main interest for us is that the Cancellation tests 
arc now in very common use. A Cancellation sheet is about the 
first one that enters a newly established laboratory. One college 
is trying them out, along with others, as a partial entrance test. 
If other researches substantiate this one and experimenters con- 
tinue to use it, the test must be interpreted negatively. But even 
here the correlation is so low the test is just about valueless for 
any positive purposes. 

(e) The Correlations with Mental Ability of the Tests which 
Measure Accuracy and Speed Are Smaller than the Similar 
Correlations of the Tests which Measure Accuracy, Speed, 
and Power 

Psychological and educational tests are readily divisible into 
two main groups: tests which measure accuracy and speed and 
those which measure accuracy, speed, and power. The factors, 
accuracy, speed, power, are really elements of every psychological 
test, hence our division may seem to the reader somewhat arbi- 
trary. The division into two groups is due not so much to differ- 
ences of elements as to differences of emphasis. The emphasis 
in the first group is upon accuracy and speed so let us call the 
tests classified there, 'speed tests.' In the second group the em- 
phasis is upon accuracy and power, so let us call these tests, 
'power tests.' 

As stated before, speed tests measure accuracy and speed 
primarily. They are usually simple in form and easily within 
the ability of the group being tested. Further, all parts of the 
test are about equally difficult. The chief characteristic of this 
type of test is that its units seldom approach in difficulty to the 
maximal ability of the group being tested. The instructions 
accompanying these tests, are to work as rapidly as possible with- 
out making errors. Our own Addition is an excellent example 
of a speed test. Courtis's Arithmetic as usually given is another 
example, though with sufficient time his tests could be used in 
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such a way as to make them power tests. Practically all the tests 
employed by the older, traditional psychology, such tests for 
example as 'Reaction Time,' 'Cancellation,' etc., belong in this 
group. 

The power tests involve speed, to be sure, but the chief factors 
are accuracy and power. By 'power test* we mean one that 
contains units sufficiently difficult to discover the maximal ability 
of the person or persons being measured. A power test is usually 
of a more complex nature than a speed test. The first part is so 
easy as to be within the ability of the stupidest member of the 
group being measured, while the remaining parts of the test 
grow progressively more difficult until the maximal ability of 
the brightest individual is measured. Our Trabue Completion 
is an excellent example of this type. The Binet Test belongs 
in this group also. Mr. Clifford Woody is engaged in making 
arithmetic tests ^ of the same nature. In fact most of the recent 
educational and psychological tests could be classified here. 

Of the tests used in this study, Cancellation, Handwriting, Ad- 
dition, and Copying Addresses are speed tests, while Visual 
Vocabulary, Completion, Reading, Arithmetic, and Omnibus are 
power tests. We have called the Omnibus a power test not 
because it is of the same nature as Completion but because it is 
complex, because some of its units grow progressively more 
difficult, and especially because all the units of the test hover 
close to the maximal ability of the group tested. 

For the practical purpose of measuring mental ability which 

tests offer more promise, those of the speed type or the power 

type? The first evidence we have to offer is shown in column 2 

of Table I. The coefficients in that column do not recommend 
o 
^ , the speed tests. Of the five different kinds of tests used, Copying 

Addresses proves itself the best as a measure of mental ability. 
But even it is always surpassed in correlation by what we have 
termed the 'power tests.' Of course, this comparison, which 
has resulted unfavorably for the speed tests, refers only to the 
tests used in this research. Copying Addresses, however, prob- 
ably ranks considerably above the average speed test in its corre- 
lation with mental ability. At least it probably occupies as 

1 "Measurements of Some Achievements in Arithmetic," Clifford 
Woody, Teachers College, Columbia University, Contributions to Educa- 
tion, No. 8o. 
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favorable a position with respect to the speed tests as does, say, 
Visual Vocabulary with respect to the power tests. In so far as 
this is the case, the scope of our comparison extends to tests not 
employed in this study. 

It is interesting to enquire into the causes for this difference 
in correlation between the speed and power tests. We believe 
that the emphasis upon power, not as opposed to but as superior 
to speed, is one significant element. Much more experimentation 
would be required to establish this view, but so far as they go 
our results harmonize with such an assumption. Another sig- 
nificant element seems to be the complexity of the function tested, r\ 
On the whole the power tests do measure more complex functions. . ' 
The Omnibus is preeminent in complexity and in correlation with 
mental ability. The Cancellation tests are preeminent as to the 
narrowness of function they measure and they are last in^ihdf 
correlation with mental ability. The tests in Table I^'are ar- 
ranged in the order of their correlation with mental ability. An 
order for complexity, so far as we can judge complexity by 
external appearance, would seem to correspond very closely to 
this arrangement by correlation. It is a matter for congratulation 
that the more recent mental and educational tests are embodying 
these elements of complexity and power. It is a pity the simple 
speed tests are not as valuable as the complex power tests, for 
they are easier to score. Furthermore, the complex power tests 
are not readily usable in long time practice experiments. By 
increasing the complexity of the speed tests we may yet make 
them valuable measures of mental ability. 

In our comparison thus far we have considered only cor- 
rected coefficients. The practical measurer of mental ability 
must base his conclusions upon raw scores and not upon scores 
derived from many more measurements. Hence a practical com- 
parison of speed and power tests must be made with raw as well 
as corrected coefficients. Table I gives the raw coefficients not 
only of each test with every other test, but, what concerns us most, 
the raw coefficients of each test with the Composite. Since each 
test has two or more coefficients with every other test. Table I 
is rather confusing, so for convenience, the reader is referred to 
Table J which is an average of the coefficients of each test with 
every other. 
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Table J permits a comparison of the closeness of raw correla- 
tion between each power test and the Composite with that between 
each speed test and the Composite. Consulting this table we dis- 
cover that Copying Addresses, which is the best of the speed 
tests, shows a correlation of -}- .49 with the Composite, while 
Omnibus shows a correlation of + .80. In every instance, except 
in the case of Arithmetic, Copying Addresses gives a lower corre- 
lation with mental ability than do the power tests. So the raw 
coefficients say as emphatically as the corrected coefficients that 
a better idea of mental ability can be gotten by measuring with 
Omnibus, Completion, Visual Vocabulary and the like than could 
be gotten by running a practice experiment with Copying Ad- 
dresses, Handwriting, Addition, or Cancellation. 

The comparison of the speed and power tests is not yet com- 
plete. The speed tests as used in this study 'make available two 
important measures: an average of all the daily scores and the 
amount of improvement shown by subtracting the first measure 
of a test from the last measure. In general, a power test pro- 
vides just one measure or else sO few measures that improvability 
is too small to be of much use. Hence the power test has but 
one measure to balance the two obtainable from a practice test. 
It is conceivable that improvability with a speed test is a better 
intellectual index than a score from a power test. To discover 
if this be the case, the improvements made in the practice tests 
were correlated with the Composite. The improvement arrays 
were calculated in the following manner: the scores made on 
the first day by any one individual in Cancelling 2 and Cancelling 
3 were combined and subtracted from the sum of the scores made 
on next to the last day. In order to get a reliability measure and 
to correct for attenuation, a second measure was calculated for 
each individual by subtracting the combined scores made on the 
second day from the combined scores of the last day. By a similar 
procedure a double measure was calculated for Cancelling A, f6r 
Addition, and for Copying Addresses. The absence of any in- 
dividual on any one of the four critical days was corrected for 
as in Chapter III, Sec. i. The improvement thus calculated was 
correlated with the Composite by the method described in the 
early part of this book, the only difference being that in correct- 
ing for attenuation the other half of Spearman's formula was 
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used. The raw and corrected Pearson coefficients arc given in 
Table K. 

TABLE K 

Correlation of Improvement with Mental Ability (Composite) 

Raw Coefficients 

Cancellation 2 + 3 (i) with (2) (Reliability) 83 

Cancellation 2 + 3 O ) with Composite (2) 26 

Cancellation 2 + 3 (2) with Composite (i ) 13 

Cancellation A (i) with (2) (Reliability) 41 

Cancellation A (i) with Composite (2) — .09 

Cancellation A (2) with Composite (i ) 07 

Addition (i) with (2) (Reliability) 80 

Addition (i) with Composite (2) 38 

Addition (2) with Composite (i) 13 

Copying Addresses ( i ) with (2) (Reliability) 52 

Copying Addresses (i) with Composite (2) 10 

Copying Addresses (2) with Composite (i) 00 

Average Raw Coefficients 

Cancellation 2 + 3 with Composite 20 

Cancellation A with Composite — .oi 

Addition with Composite. 26 

Copying Addresses with Composite 05 

Corrected Coefficients 

Cancellation 2 + 3 with Composite 21 

Cancellation A with Composite 

Addition with Composite ^ 

Copying Addresses with Composite 

If we compare the average raw coefficients of correlation in 
Table K with the column tmder Composite in Table J we see 
that improvement in the practice tests was, if anything, an even 
poorer measure of mental ability than was an average of all 
the scores. By the use of averages Copying Addresses did show 
a substantial correlation with the Composite, whereas by the use 
of an improvement measure, its correlation dropped almost to 
zero. 

In considering the practical value of tests, other factors than 
those discussed should receive at least a passing mention. These 
are ease of administration and scoring and the amount of time 
required. Further it is just as important to ask what is the dis- 
tribution of the time given to the test as it is to ask how much 
time is actually spent in testing. Thirty minutes of testing con- 
centrated in one period, for example, is usually more convenient 
than fifteen minutes distributed over three days. 
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Of all psychological tests the Binet is the best known and the 
most perfectly standardized ; yet for general use it will probably 
be supplanted by tests which require less skill and less time to 
apply. The problem of extending the sphere of psychological 
and educational measurement is very largely that of substituting 
group for individual testing. The speed tests and power tests 
used in this study are all well adapted for group measurement. 
They do not materially differ in ease of administration, nor is 
there a very great difference in ease of scoring. There is a differ- 
ence, however, and this difference favors the speed tests. The 
speed and power tests can be compared for time and convenience 
by consulting Table G. This table considered in conjunction 
with Table J shows that one hundred minutes of Copying Ad- 
dresses when distributed over ten days gives a correlation of 
-)- .49 with the Composite. Omnibus with only sixty minutes of 
continuous testing gives a correlation of -j- .80 with the Com- 
posite. In every instance the time spent upon the power tests 
was considerably less than that spent upon Copying Addresses. 
To sum up the entire discussion, the power tests give a much 
higher correlation with mental ability than do the speed tests; 
and this is true whether average score or improvement is used 
as the measure of the speed tests. Further, the power tests equal 
the speed tests in ease of administration, and they surpass 
them in time convenience. Ease of scoring, only, favors the speed 
tests, but this superiority is so slight as to be qi small conse- 
quence. 

The issue thus far has been drawn, on the one hand, between 
those of our tests which are simple in nature, which measure a 
relatively narrow function, which are considerably below the 
upper limits of ability, which have units roughly equal and which 
were designed and are adapted to measure speed and accuracy; 
and, on the other hand, those tests which are relatively complex, 
which measure a wider range of functions, which hover close 
to the upper limits of ability or else begin easy and grow pro- 
gressively more difficult. Thus far we have considered the com- 
parative excellence of these two main groups of tests as measures 
of mental ability. We can further draw the issue not between 
the two types of tests but between the two methods of adminis- 
tering any of them. It has been claimed that the amount of 
improvement shown by a practice test is a better intellectual index 
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than are "snap-shots" with those tests. The snap-shot test meas- 
ures improvement from birth or conception, not to go back fur- 
ther, to the time in the life of the individual when the test is 
given. The practice test, on the other hand, measures improver 
ment from the first to the last trial at that particular test. This 
issue could be settled fairly only by comparing the coefficients 
gotten by correlating the score from the first trial with mental 
ability and by correlating improvement, foun^ by practice at 
that same test, with mental ability. But here our troubles begin. 
Those complex, snap-shot tests which show a high correlation 
with mental ability cannot conveniently be used in a practice ex- 
periment. And since only those which we have called the speed 
tests CBn be readily used for practice purposes the issue is really 
the same as that between the speed tests and the power tests, the 
speed tests representing the improvement measure and the power 
tests representing the snap-shot score. The decision reached in 
the preceding discussion favored the power tests. 

It is possible, however, to view the speed tests, such as Addi- 
tion, Copying Addresses, etc., as snap-shot as well as practice tests, 
and thus secure a comparison of the two methods. The first 
trial of these tests has not been correlated with mental ability 
but improvement has, and the results are shown in Table K. 
If the average from all the trials may be considered as at least 
a partial representative of the first trial then the coefficients for 
the speed tests in Table J under the Composite reveal some inter- 
esting inconsistencies. Measured by an average. Copying Ad- 
dresses shows the closest correlation with mental ability of all the 
practice tests; measured by improvement it shows about the 
least correlation. The average correlates a little closer than the 
improvement in the cases of Addition and Cancellation of A's, 
while improvement has a slight advantage in the case of Can- 
cellation of 2 and 3. However we may explain these apparent 
inconsistencies by differences of physiological limit, the fact re- 
mains that improvement in these tests is a very poor measure 
of mental ability, even poorer than an average, and probably no 
better than a first trial. In no case does it even approach a snap- 
shot score for a power test. 
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5. What Are Some Theoretical Considerations Growing 

Out of This Study? 

(a) Is there such a thing as a negative correlation between 
desirable functions? Is the law of human nature correlation or 
compensation ? 

Rightly or wrongly Emerson is usually held responsible for a 
philosophic statement of the law of compensation. The law 
has been given a more scientific terminology by certain German 
psychologists, especially in connection with their attempt to clas- 
sify individuals into types. Stated in whatever form, the impli- 
cation is that there exists a negative correlation between desirable 
traits. From such a doctrine springs the idea that the higher 
the ability in dealing with abstract things, the lower it is in dealing 
with concrete things; that slow learners are long rememberers; 
that the person endowed with beauty is by the justice of Nature 
left devoid of brains; in short that Nature always balances a 
superiority with an inferiority. In the third volume of his "Edu- 
cational Psychology," Professor Thomdike vigorously assails 
this doctrine. "It should also be noted that in original nature 
the rule is correlation, not compensation." Or again, "It is very, 
very hard to find any case of a negative correlation between de- 
sirable mental functions. Divergencies toward what we vaguely 
call better adaptation to the world in any respect seems to be posi- 
tively related to better adaptation in all or nearly all respects. 
And this seems especially true of the relations between original 
capacities." In the stand taken by Dr. Thomdike, the author 
heartily concurs. Hence it is with no small surprise that he finds 
himself compelled to appear as a defender of inverse correlation 
between desirable mental functions. The only way to avoid 
the necessity of advocating a theory so unpopular with recent 
psychology is to call the ability to cancel the figures 2 and 3 
or the letters A and S, an undesirable mental trait. The ability to 
perceive a thing, pick it out from other things, and do something 
with it seems so fundamental to all our mental life that we are 
scarcely justified in calling such an ability undesirable. Nor can 
we, without outraging the best of our common sense, call unde- 
sirable the abilities to do the Visual Vocabulary, Completion, 
Reading, Arithmetic, and Omnibus tests, or to make good marks 
in school and secure the teachers' esteem. And yet between the 
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Cancellation tests and this more complex group we find a negative 
correlation. 

If the reader will turn back to Table I and count the number 
of coefficients of correlation which have been calculated between 
the Cancellation group and the complex tests mentioned above, 
he will discover that there are 56 such coefficients. Of these 53 
are negative and only 3 are positive. Further, of these 3 not one 
coefficient is as large a positive as +.10 while there are negative 
coefficients of — .35, — .36, — .37 and — .39. The average of the 
3 positive r's is +-^7' ^^^^ average of the 53 negative r's is 
— .21 (P.E. .08). Some of the negative coefficients are small 
enough to be due to chance, but it is much easier to believe that 
the 3 positive ones are due to chance. In view of the size of the 
negative coefficients and the unanimity of results from all the 
tests we are forced to conclude that the inverse correlation is 
genuine. Nor is this genuineness unsupported by previous ex- 
perimenters. Dr. Chapman ('14), "Individual DijBferences in 
Ability and Improvement and Their Correlation," using the same 
Cancellation 2 and 3 tests upon twenty-two college students, found 
correlations between Cancellation and Mental Multiplication of a 
three-place by a three-place number as follows : .00, .03, .16, — .05, 
— .13, — .14. These coefficients will average a small negative. 

If future results substantiate our findings, what does it mean ? 
It means that a negative correlation can exist and that many 
more may exist than we at present suppose. There are those 
who believe that training in one mental function is transferred to 
another in proportion to the size of the positive correlation be- 
tween the two. If there be anything in such a belief, positive 
transfer accompanying a positive correlation may imply ^ a nega- 
tive transfer accompanying a negative correlation. Such a state 
of aflfairs existing would mean that to educate a person in one 
trait would be to uneducate him in all the traits correlating 
negatively with it. It is not impossible to conceive that some 
of the more or less trivial traits intensively developed by the 
schools correlate negatively with a hundred valuable abilities. 
The mere possibility argues for the future development of ex- 
perimental education. Our knowledge is very meagre. The 
wells which man has digged in the earth are far more numerous 
than the borings which psychology has made into the mental life. 
^ Such an implication is not necessarily true. 
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Though all these things be possible, we nevertheless believe 
with Dr. Thorndike that the law of human nature is correlation 
and not compensation. Although correlational psychology is a 
new science, it has several thousand coefficients to show for its 
labors. Never before, so far as the writer is informed, has a 
negative coefficient been so persistently in evidence. If inverse 
correlations were numerous, more should have made their ap- 
parance by this time. Further, the negative correlations found 
in this research may not mean that the functions are intrinsically 
inverse. Had a sufficient reward been offered, it may be that 
the brighter pupils in the complex tests would have forged ahead 
in the Cancellation tests. In a simple test like Cancellation possi- 
bly the brighter children lost interest first. Quite conceivably, dif- 
ferent abilities have different interest and attention levels. Simple, 
routine, relatively easy tasks might be just right to interest the 
stupid, while they bored the abler individuals unutterably. Tasks 
difficult and complex enough to interest the abler individuals might 
be beyond the interest and attention of the stupid. A complete 
explanation of the cause would have to explain at the same time 
why the average from cancelling figures gave a negative correla- 
tion with the Composite while improvement at cancelling figures 
shows a slightly positive correlation with the Composite. 

(b) What bearing do our results have upon Spearman's Com- 
mon Factor ? 

The reader will remember that just a few pages back we were 
so unwary as to become involved in a discussion of the cause 
for a negative correlation. Why mental functions correlate in 
any way, whether negatively or positively, is one of the most 
vital, most difficult, and most disputed problems with which corre- 
lational psychology has dealt. One step toward an explanation 
has been an attempt to determine the correlational grouping of 
mental traits. Here the question asked is : With respect to their 
intercorrelations just how do the multitude of mental traits group 
themselves, into one system, two systems or many systems? 
Concerning this there are three different theories, the "multi- 
focal," the "intermediate," and the "unifocal." 

Spearman in an article entitled, "General Ability, Its Existence 
and Nature," published in Volume V of the British Journal of 
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Psychology, summarizes the "multifocal" theory, viz.: "Accord- 
ing to this view, ability in any performance depends upon a 
complex of elementary factors ; the correlation between two per- 
formances simply measures the degree in which the elementary 
factors demanded by the one happen to coincide with, or to be 
bound to, those demanded by the other. The elementary factors 
include both 'form' and 'content' ; by form is meant the kind of 
mental operation, as discrimination, observation, inference, etc.; 
while the 'content' denotes the different sorts of data, as color, 
shape, number, etc., submitted to such operations." 

Between the "multifocal" and "unifocal" theories there are 
various intermediate ones which organize mental traits into a 
variety of "faculties," "centers," or "levels." Psychologists who 
classify the mental life into "types" or "faculties" imply that the 
multitude of functions composing any one "faculty" or "type" 
show a close correlation with one another while they show a loose 
correlation with traits which belong in a different "faculty," 
"type," or "center." Dr. Thomdike seems to believe in correla- 
tional "levels" when he writes: "Correlations seem to be closer 
within the anal)rtical or abstracting functions than between these 
and others. So also within the purely mental associative functions 
like adding, completing words, giving opposites or naming objects, 
than between one of them and one of the sensori-motor functions. 
The sensivities seem to interrelate only loosely; and any one of 
them would relate very loosely to the associative or analytical 
ftmctions, even when the latter was busied with data from that 
sense."^ 

The "unifocal" theory is represented by Dr. Spearman's famous 
"Common Factor." To quote from Spearman himself: "Here, 
the view supported is that all performances depend to a certain 
degree upon one and the same general common factor, provision- 
ally termed 'General Ability.' Correlations are thus produced 
between all sorts of performances, the amount of correlation 
being simply proportional to the extent that the performances 
concerned involve the use of this general common factor, or 'Gen- 
eral Ability.' " * This criterion proposes not as many centers as 
there are "elementary factors," not as many centers as there are 
"faculties" or "types," nor even as many centers as there are 

^ Elducational Psychology, Vol III, p. 370. 

2 British Journal of Psychology, Vol. V, p. 52. 
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"levels"; rather it proposes just one center. In the same article 
Spearman summarizes the importance of this qi^estion by saying : 
"This sharp divergence between the three current views appears 
to be of grave importance. It bars the way to all interpretation 
of our laboriously accumulated correlational data. It confutes 
all theory as to the intellectual 'make-up' of individuals. And it 
paralyzes our practical power of gauging the intelligence of per- 
sons, both normal and insane." Following this statement Spear- 
man proceeds to give his proof of the existence of the "Common 
Factor" and of the inadequacy of all previous conceptions. After 
many psychological considerations he decides that the "Common 
Factor" is "some common fund of energy/' Finally he concludes 
with: 

"( I ) At present, there exists such a great divergence of opinion 
about the correlation between different intellectual performances, 
as to impede gravely the progress of psychology. 

"(2) But closer consideration of all the actual data of the 
different authors shows that this divergence is merely due to 
gross misinterpretation. In reality, all the facts indicate unani- 
mously, that the correlation arises through all the performances, 
however different, depending partly on a General Common Fac- 
tor." 

Do our results support Spearman's contention and justify 
his conclusions ? The first evidence we have to offer is the nega- 
tive correlation between the Cancellation group and the Complex 
tests. Correlation, according to Spearman, is produced by the 
General Common Factor and modified by the "specific abilities" 
of the traits correlated. To quote again : " . . . every intellectual 
performance may be regarded as proceeding from two distinct 
factors; on the one hand, the specific ability or disposition for 
that particular performance; and on the other general ability, 
due to the common fund of intellective energy." What Spearman 
meant by "specific ability" may be gathered from these quotations : 
"An 'ear' for melody is known to be particularly specific, that is, 
independent of other elementary capacities." And again, " . . . 
their correlations (specific) do not occur in a pure state, but 
only superposed upon correlation of a more general character." 
The theory of the Common Factor seems to require that all 
coefficients of correlation be positive. How two functions can 
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share in a Common Factor and yet show a negative correlation 
we are unable to see. Perhaps the Cancellation traits are ostra- 
cized from the exclusive society of the Common Factor. Perhaps 
in the tug of war the "specific abilities," heading in a negative 
direction, outpulled the Common Factor. The proved skill of 
Dr. Spearman could doubtless defend his theory from such a 
trivial attack. 

In the article already referred to, Dr. Spearman proposes a 
remarkably ingenious and important method of treating correla- 
tional results. By this method he proved to his satisfaction the 
existence of a Common Factor, hence the fate of his theory de- 
pends upon the proper working of this method. We purpose to 
treat our results by exactly the same method to see whether they 
justify a belief in a General Common Factor. In his article 
Spearman gave a correlational table which had the general form 
of the one given below. (The coefficients are not the same.) 
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Concerning the table of coefficients which Spearman gave, he 
wrote : "The most obvious method would be to devise as criterion 
some direct function of all the coefficients in the table. We have, 
however, chosen a somewhat different course. It seemed desir- 
able to retain the power of noting whether the whole table 
obeyed the same law or different parts of it behaved differently. 
Also we were anxious to simplify the calculations as far as 
possible, in order to appeal to a wider circle of readers. For these 
reasons, our criterion was based upon singling out from the table 
any pair of columns of coefficients. . . . Our criterion consists 
simply in the correlation between one column of figures and the 
other ; it is the correlational coefficient between the two series of 
correlational coefficients ; clearly this is just as easy to work out 
as between any other two series of values. It should be noted 
that this correlation between columns is quite independent of the 
arrangement in which the table happens to have been drawn 
up. 

Also Spearman tells us that he threw away the two coefficients 
which had no corresponding coefficients in the other column. And 
then, a few pages further on, he says : "Such, then, is the statisti- 
cal method which we have devised for deciding between the three 
rival theories. If the older view of Thorndike, vis,, 2l general 
independence of all correlations, holds good, our correlation be- 
tween columns of correlational coefficients should average about o. 
If his newer view of "levels" or the almost universal belief in 
"types" is correct, then the mean correlation between columns 
should be a low minus value. If, finally, the true theory is that 
of a General Common Factor, the correlation between columns 
should be positive and very high/* 

Since Spearman's method has been applied to average raw 
coefficients it is highly desirable that the halves of a test from 
which the coefficients were derived measure substantially the 
same thing. Otherwise an average of the raw coefficients would 
be somewhat misleading. To this end, no test has been used 
which did not show a reliability coefficient of +-70' According 
to Table G this criterion eliminates Arithmetic and Reading. 
Visual Vocabulary and Completion were combined, thus raising 
their reliability coefficient to +-69i which was accepted as satis- 
factory. The intercorrelations of the accepted tests are given 
in Table L. It is upon this table that we purpose to test the 
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Spearman theorem. The reliability criterion was set up and tiie 
correlation table was constructed before it ever occurred to the 
writer to enquire whether it would operate favorably or un- 
favorably to the "Common Factor." 

Now, if Spearman's "unifocal" or "Common Factor" theory is 
to be corroborated, the correlation between any two columns of 
Table L should be, to use his own words, ''positive and very 
high." To be exact, Spearman says the average of all the corre- 
lations should be positive and very high. But Spearman himself 
would be the first to say that unless all parts of the table sub- 
stantially agree, the use of an average would conceal rather than 
reveal the truth. He perceived this when he wrote: "It seemed 
desirable to retain the power of noting whether the whole table 
obeyed the same law or different parts of it behaved differently." 
It cannot be emphasized too strongly that, according to Spear- 
man's statistical method, the crucial thing, in the last analysis, 
is not the size of the average; it is the size of the correlation 
between any two columns taken from the correlational table. 
Bearing this in mind, is the correlation between any two columns 
of Table L "positive and very high," or does it tend even to be 
"positive and very high" ? Taking various pairs of perpendicular 
columns from Table L and correlating them we get such results 
as the following: 

Cancelling 2 with Visual Vocabulary + Completion — .95 

Cancelling 3 with Omnibus — .95 

Cancelling A with Teacher Rank — .83 

Cancelling S with Composite — .91 

Any one of the tests shown to the left paired with any one of 
the tests at the right would give similar coefficients to the above. 
The results are just exactly opposite to what is required to satisfy 
Spearman's theory. Instead of the coefficients being "positive and 
very high" they are negative and very high. What then led 
Spearman to believe in a Common Factor? The answer is given 
in the following : 

Cancelling 2 with Cancelling 3 , +1x30 

Omnibus with Visual Vocabulary + Completion + .99 

Many more such high positives could be given. Mere inspec- 
tion of Table L will show that the correlation between any two 
columns from Cancelling 2 through Cancelling S would give a high 
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positive. A high positive coefficient would also be gotten from 
any pair from Visual Vocabulary + Completion through Com- 
posite. On the other hand, the correlation of any column in the 
first group with any column in the second would be a high nega- 
tive. What would the average be ? A mistake I 

Lest anyone should think that the coefficients from correlated 
columns always approximate unity, note the following smaller 
coefficients : 

Handwriting with School Mark — .56 

Cancelling 2 with Copying Addresses .00 

Addition with Visual Vocabulary -|- Completion +.51 

Between -f-.5i and — .56 other intermediate coefficients could 
be given. By the proper selection of columns to be correlated, 
data could be found to support all of the three main theories, the 
"multifocal," the "faculty" or "type" or "level," and the "uni- 
focal." 

Objections will be urged against our correlational table (Table 
L) . It could easily be said that Teacher Rank does not measure 
a mental trait at all, unless perhaps it be a mental trait of the 
teacher, and therefore such a measure should not be included in 
the table of correlations. It was retained because Dr. Spearman 
speaks of using "Imputed Intelligence" in his tables. But the 
omission of Teacher Rank would not change the general con- 
clusion. 

The only really important criticism would concern itself with 
the number of the Cancellation tests. Spearman would probably 
say that because of them our table is overloaded with "specific 
abilities." He himself combined two Cancellation tests which 
occurred in one of his tables, though he offered no justification 
for such a procedure, except that the tests were similar. If the 
tests were practically identical there could be no objection to 
his combining them. Likewise it would be difficult to protest 
had he elected to treat them separately, for they were not exactly 
the same test. If correlation be due to "specific ability" plus 
"Common Factor," we should not forget the work of Thomdike 
and Woodworth. They have shown experimentally that traits 
which seem almost identical may really not be so at all. If 
external similarity be our measure of "specific ability," the corre- 
lation between Cancelling A and Cancelling S would be higher 
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than between Visual Vocabulary -f- Completion and Omnibus. 
As a matter of fact, the correlation is +-57 ^^ ^^^ ^^^t case and 
-|-.6o in the second. There is no more reason for combining these 
two Cancellation tests than for combining the Visual Vocabulary 
-|- Completion and Omnibus. But supposing we yield the point 
and retain only Cancellation 2 and Cancellation A, then the re- 
maining columns can be correlated to give a result like this : 

Cancellation 2 with Omnibus — .94 

But to be still more generous, we have thrown out every Cancel- 
lation test except Cancelling 2 ; yet we can get a result like this : 

Cancelling 2 with Omnibus — .92 

In view of the foregoing we are forced to conclude that Spear- 
man's theory does not have universal validity. And we have 
proved this by the application of his own statistical method. Dr. 
Spearman certainly bases his theory upon numerous data col- 
lected from many sources. His averages certainly were positive 
and high, and he explicitly states that no individual correlation 
of column with column fell appreciably below positive unity. Had 
we correlated every column in Table L with every other column 
and had we taken an average of all these correlations, the mean 
result would have been a substantial positive. But in view of the 
differential action of different parts of the table, such a summa- 
tion would be not only misleading but wrong. 

Dr. Spearman after advancing and defending his theory of 
the Common Factor proceeds to state the nature of it. Concern- 
ing the former, Burt writes : "The first of Dr. Spearman's propo- 
sitions, the 'Theorem of the Universal Unity of the Intellective 
Function' is tested by a corollary logically issuing from it, called 
that of the 'Hierarchy of the Specific Intelligences.' Its principle 
may be most briefly expressed as follows : 

r (A. P) _ r (A, Q) 
r (B, P) r (B, Q) 

where A, B, P, Q, represent any four capacities not obviously 
akin.^ "^When this formula is satisfied a correlational table can 
be so drawn up that the coefficients in horizontal columns grow 

1 British Journal of Psychology, Vol. Ill, p. 159. 
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smaller to the right and those in perpendicular columns grow 
smaller downward. Burt's coefficients did substantially satisfy 
the above formula, and when thrown into the usual table they 
formed a beautiful 'hierarchy/ Consequently, Burt agreed with 
Spearman's first theorem. The 'Common Factor' and the 'Hier- 
archy of the Specific Intelligences' must stand or fall together. 
Just as our results do not corroborate Spearman's contention, 
neither can our coefficients be so arranged as to show a hierarchy. 
Burt, like Spearman, claims that the above formula only holds 
when the capacities are "not obviously akin." This is the crucial 
point. We are insisting that external similarity is not a satis- 
factory measure of kinship. But even when we yielded to ex- 
ternal similarity so far as to eliminate every Cancellation test 
except one, our results failed to substantiate Spearman's 'Com- 
mon Factor' or Burt's 'Hierarchy of the Specific Intelligences.' 

Complete fairness to Dr. Spearman makes another remark 
necessary. Spearman points out that what he calls "sampling 
errors" introduce a definite bias into the results obtained by cor- 
relating columns of coefficients, and that to determine the exact 
size of the coefficient this bias must be corrected for by a for- 
mula which he gives. In order that the correction may not be 
so great as to swamp the real diflference, he sets up an arbitrary 
correctional standard by which he excludes those columns which 
have large sampling errors. Unfortimately, we have been unable 
to make clear to ourselves just how he applies this standard, 
hence our correlational table has been left unmodified. For this 
reason we do not correct our results by his formula but present 
them in their raw form. Anyway, the exact size of the coefficient 
is not necessary to test Spearman's theory. And even though 
Spearman finds that some column used by us did not quite 
satisfy^ his correctional standard, it is hardly conceivable that the 
sampling error could be so large as to completely reverse the 
direction of the coefficients upon which our conclusion is based. 

In correlating two colunms from a correlational table, two 
coefficients must be thrown away, one from each column. This is 
necessary because there will always be one coefficient in each col- 
umn which lacks a corresponding coefficient in the other. But 
what is worse still is that every time a new pairing of columns 
is made different coefficients are eliminated. This increases enor- 
mously the labor of calculating the intercorrelation among the 
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columns, for with each new pairing a new average, a new set of 
deviations, and a new sum of deviations squared must be calcu- 
lated. In calculating the Pearson coefficients for ordinary arrays 
these things are done but once. To minimize labor, therefore, 
we suggest that the coefficient -f-i-oo be inserted at every place 
in the correlation table where there is a gap. An array will, of 
course, always correlate -|-i.oo with itself. This coefficient is 
usually omitted in drawing up a correlational table because to 
insert it would not be particularly illuminating. Where, however, 
we wish to apply Spearman's statistical method such an inser- 
tion would prove exceedingly serviceable. We did not use the 
-|-i.oo in calculating any of the coefficients used in our attempt 
to refute the two theories of Burt and Spearman. We believe 
that to fill up the gaps in a correlational table in this way is 
theoretically correct. In every case where we have tried correlat- 
ing columns with and without the -j-i-oo the coefficient has been 
very nearly the same. But even though the coefficients were not 
the same, the insertion of the -j-i-oo might still be justifiable. We 
merely mention it here in the hope that some one with sufficient 
training in the theory of correlation will test our suggestion. 



CONCLUSION 

The mere wording of a question may stimtilate thinking which 
will result in experimental research. It is our only excuse for 
asking so many questions and giving a final answer to so few. 
Certain conclusions grow out of this study, but the amount of 
data in any one research is necessarily so meagre that universal 
validity can scarcely be claimed for any of them. But in view 
of the limitations of the study, the following seem to us worth 
a place in a stuxunary : 

1. The corrected correlations among the educational and psy- 
chological tests and the functions which they measure contin- 
uously vary in size from — .63 to +.98. 

2. Meaning by mental ability a Composite of all the measure- 
ments, the Omnibus and Completion tests correlate with it 4-I-00 
and -f-.96, respectively. That is to say, a perfect meastu-e of an 
individual by Omnibus or Completion would be a substantially 
true index of his mental ability. 

3. The seven best measures of mental ability together with 
their correlations with the Composite are: Omnibus i.oo. Com- 
pletion .96, School Mark .91, Teacher Rank .86, Reading .81, 
Visual Vocabulary .80, and Arithmetic .72. 

4. Ranked in the order of their correlation with mental ability 
the complex educational and vocational tests come first, the rela- 
tively complex practice tests second, and the simple practice tests 
last. 

5. The power tests, or those which measured the upper 
threshold of ability, showed a higher correlation with mental 
ability than the speed tests or those which measured how rapidly 
a relatively easy task could be accurately performed. The power 
tests were superior not only as to correlation but also as to time 
required and the distribution of that time. 
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6. The indications are that for a test to show a dose correla- 
tion with mental ability it should emphasize power rather than 
speed and test a relatively complex function rather than a narrow 
mental trait. 

7. Improvement at a speed, practice test was on the whole not 
so good an intellectual index as an average of the practice scores 
and not nearly so good an index as a single score from a complex, 
power test. 

8. In this particular 6 B school grade chronological age corre- 
lated negatively with mental ability. 

9. The Cancellation tests correlated negatively not only with 
the Composite but also with all those tests which proved to be 
good measures of mental ability. This demonstrates that a nega- 
tive correlation between apparently desirable traits can exist. 
Heretofore, the weight of scientific evidence has been against 
such a possibility. ' 

10. The correlation between dolumns of correlational coeffic- 
ients does not corroborate Spearman's important "Theorem of 
the Universal Unity of Intellective Function." 

11. In no way can a correlation table be so constructed from 
our coefficients as to satisfy Burt's "Hierarchy of the Specific 
Intelligences." 

12. A suggestion was made whereby gaps in a table of co- 
efficients can be filled. This suggestion, if justifiable, will greatly 
economize labor in applying to a table of coefficients Spearman's 
statistical method of correlating columns of correlational co- 
efficients. 
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APPENDIX 



General Instructions for the Six Preliminary and Six Final Tests : 

I am going to give you several tests to find out how good a score 
you can make. Do your best in each test To-morrow I shall read the 
names of the two making the highest total scores. Notice carefully all 
instructions so you will not need to ask questions and thus disturb others. 

(Read before each series.) 

Instructions for Visual Vocabulary, Reading, Completion, Arithmetic, 

Omnibus and Proverb: 

There will be placed before you, face down, a sheet of paper. This 
paper tells you what to do and how to do it. You will have 30 minutes 
in which to complete the test. When you have finished everything on the 
paper, bring it to me and return quietly to your seat. Don't look at 
your paper until I say "Go," and stop instantly when I say "Stop." Do 
what it says to do. 

(Read before each test) (Proverb: 15 min.) 

Instructions for Cancellation : 

You will be given a cancellation sheet. In this sheet a certain specified 
number or letter must be cancelled. Omit as few cases and cancel as 
many as you can in one minute. The sheet will be placed before you 
bottom-side up. When I say "Cjo," turn the sheet over and commence to 
cancel. When I say "Stop," cease immediately. Your score will be as 
follows : 2 (number cancelled correctly) minus 2 (number omitted) minus 
3 (number wrongly marked). Watch while I show how it should be done 
and then you can practice at it yourself for one minute. 

Instructions for Addition : 

You will be given a sheet containing columns of one-place numbers. 
Place it before you bottom-side up. When I say "(jo," turn the sheet 
over and begin adding. Write the sum of each column of ten figures 
under the line at the bottom of that column. Add as many columns as 
you can in ten minutes without making errors. If an sinswer is wrong 
you will receive no credit for that colutnn. When you finish the examples 
on one sheet take another. Watch while I show you how it is done and 
then you can practice it yourself for five minutes. 

Instructions for Copying Addresses: 

You will be given a sheet containing 25 names and the directory from 
which these names were taken. Look in the directory for the first name 
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on your sheet, find the New York City address and write it after that 
name on your sheet See how many of these addresses you can correctly 
copy on your sheet in ten minutes. Do not begin until I say "Go/' ana 
cease immediately when I say "Stop." Watch while I show you how it 
should be done. 

Instructions for Handwriting: 

There will be placed before you face downward a printed paragraph 
which you are to copy as much of as you can in four minutes. You will 
be scored for both quality and speed, so write as fast as you can while 
writing the best that you can. Be sure to punctuate and capitalize just 
as it is in the paragraph before you. Begin when I say "Go, and cease 
immediately when I say "Stop." Watch while I show you how to do it 

Teachers College, Columbia University, publishes the Visual Vocabu- 
lary, Reading, and Completion tests. Further information concerning 
the other tests may be had by communicating with the author. 
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Cancelung A: Original scores made in i minute by 88 children. 
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Cancelling A (continued) 
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180 


118 


130 


132 


180 


128 


128 


180 


15 


148 


128 


140 


140 


142 


140 


104 


154 


1« 


132 


128 


140 


118 


138 


142 


144 


142 


17 


128 


124 


110 


130 


122 


— 


124 


128 


18 


114 


108 


114 


100 


110 


120 


120 


128 


19 


112 


110 


100 


98 


112 


112 


108 


124 


20 


180 


130 


132 


140 


144 


148 


158 


148 


21 


128 


132 


184 


130 


140 


138 


140 


150 


22 


110 


100 


122 


108 


128 


- _ 


110 


155 


28 


124 


138 


118 


132 


134 


132 


132 


130 


24 


124 


132 


130 


120 


132 


130 


144 


180 


25 


148 


140 


-— 


-^ 


— 


— 


_ 


._ 


20 


112 


110 


110 


120 


122 


182 


118 


120 


27 


110 


110 


124 


130 


138 


144 


140 


184 


28 


128 


138 ' 


138 


130 


134 


142 


130 


150 


29 


128 


140 


108 


148 


142 


144 


140 


148 


80 


90 


108 


102 


112 


110 


94 


110 


122 


81 


100 


108 


100 


106 


120 


122 


120 


118 


82 


128 


124 


130 


132 


148 


142 


158 


170 


88 

84 
85 


144 


152 


150 


140 


144 


142 


134 


142 


100 


m 


m 


110 


m 


128 


lii 


m 


80 


104 


148 


130 


132 


140 


_ 


138 


158 


87 


128 


130 


134 


130 


— 


130 


120 


... 


88 


102 


98 


120 


112 


108 


118 


122 


120 


89 
40 
41 


118 


120 


124 


110 


120 


120 


132 


128 


100 


08 


110 


98 


106 


112 


108 


100 


42 


118 


120 


124 


110 


128 


124 


130 


140 


48 


120 


118 


128 


124 


120 


120 


124 


120 


44 


140 


142 


152 


132 


138 


148 


130 


150 


50 


150 


150 


148 


102 


158 


172 


170 


170 


51 


40 


40 


08 


70 


70 


90 


104 


90 


52 


70 


72 


84 


82 


74 


90 


84 


80 


58 


— 


— 


20 


80 


40 


_> 




80 


54 


140 


102 


150 


172 


170 


109 


140 


142 


55 


118 


128 


124 


110 


122 


132 


138 


138 


50 


148 


154 


142 


162 


154 


164 


•__ 


— _ 


57 


72 


88 


104 


102 


110 


120 


112 


no 


58 


124 


130 


120 


128 


132 


134 


144 


148 


59 


120 


132 


132 


130 


148 


100 


144 


130 


00 


110 


— 


100 


104 


122 


110 


128 


114 


01 


116 


90 


114 


100 


108 


104 


112 


108 


02 


144 


150 


134 


140 


142 


134 


142 


149 


03 


122 


124 


138 


142 


152 


150 


150 


102 


04 


122 


114 


98 


— . 


118 


122 


120 


118 


05 


120 




120 


— ' 




— _ 


142 


140 


00 


112 


120 


122 


122 


130 


130 


138 


132 


07 


150 


150 


148 


100 


172 


172 


108 


108 


08 


90 


98 


100 


102 


112 


124 


108 


122 


09 


— 


— 


— . 


— . 


,— 


-^ 


.^ 


_ 


70 


104 


114 


104 


120 


110 


122 


110 


124 


71 


136 


no 


122 


128 


138 


130 




142 


72 


128 


132 


128 


132 


130 


142 


142 


150 


73 


128 


130 


130 


138 


142 


140 


148 


150 


74 


124 


122 


— 


122 


120 


120 


100 


110 


75 


136 


148 


140 


160 


158 


168 


150 


152 


76 


154 


138 


130 


132 


134 


144 


140 


100 


77 


170 


178 


190 


190 


— _ 


183 


190 


200 


78 


114 


108 


120 


120 


120 


132 


132 


120 


79 


142 


140 


— 


138 


130 


148 


152 


154 


80 


114 


122 


114 


130 


120 


134 


128 


142 


81 


130 


130 


140 


102 


150 


144 


150 


144 



8o Correlation of Psychological and Educational Measurements 



Ind. 


2/17 


2/18 


4/20 


4/21 


4/22 


4/28 


4/26 


4/27 


82 


142 


182 


142 


150 


144 


164 


172 


158 


88 


— 


■_ 


132 


126 


138 


118 


84 


28 


84 


164 


162 


162 


177 


160 


182 


186 


— 


8ft 


— 


— 


26 


76 


94 


104 


120 


120 


86 


94 


112 


122 


182 


184 


110 


142 


134 


87 


182 


186 


126 


140 


144 


146 


148 


142 


88 
89 
00 


104 


106 


88 


116 


112 


124 


124 


118 


110 


188 


la 


176 


176 


168 


174 


1^ 


91 


IftO 


144 


182 


162 


138 


138 


150 


128 


92 


116 


120 


108 


114 


116 


112 


120 


128 


98 


118 


— 


116 


124 


118 


128 


— 


140 



Addition: Original scores made in lo minutes by 88 children. 



Ind. 

1 

2 

8 

4 

ft 

6 

7 

8 

9 
10 
11 
12 
18 
14 
1ft 
16 
17 
18 
19 
20 
21 
22 
23 
24 
2ft 
26 
27 
28 
29 
80 
81 
82 
83 
84 
85 
86 
87 
88 
89 
40 
41 
42 
48 
44 
50 
51 
52 
58 
54 
55 
56 
57 
58 
59 
60 
61 
62 
68 



2/4 


2/5 


2/8 


2/9 


2/10 


2/11 


2/15 


2/16 


2/17 


2/18 


64 


71 


85 


80 


01 


98 


96 


91 


108 


117 


81 


42 


29 


— ~ 


36 


48 


89 


41 


51 


4ft 


53 


57 


57 


60 


70 


82 


77 


74 


78 


84 


22 


42 


84 


40 


89 


45 


40 


46 


36 


48 


20 


29 


— 


— 


27 


26 


30 


38 


82 


38 


— 


26 


2ft 


30 


28 


27 


35 


... 


42 


47 


30 


38 


84 


89 


88 


89 


42 


48 


35 


48 


23 


— 


20 


19 


24 


.^ 


22 


24 


27 


80 


29 


42 


41 


50 


44 


55 


60 


67 


63 


60 


9 


9 


4 


8 


4 


6 


12 


5 


10 


16 


15 


18 


18 


17 


14 


20 


20 


18 


12 


1 


13 


14 


14 


17 


25 


26 


21 


20 


23 


26 


65 


71 


68 


88 


96 


98 


90 


87 


99 


97 


68 


70 


66 


78 


79 


79 


72 


78 


84 


8ft 


17 


28 


28 


37 


28 


30 


34 


32 


43 


48 


37 


88 


40 


49 


32 


46 


42 


44 


49 


48 


14 


18 


18 


16 


18 


27 


23 


81 


82 


81 


39 


46 


48 


52 


52 


54 


58 


68 


61 


69 


57 


53 


62 


66 


54 


53 


80 


77 


86 


88 


38 


20 


44 


46 


56 


50 


47 


70 


59 


70 


18 


22 


18 


18 


28 


30 


28 


27 


20 


81 


26 


28 


82 


87 


— 


34 


82 


38 


40 


48 


86 


46 


89 


48 


55 


55 


56 


50 


63 


ftO 


42 


45 


48 


57 


54 


63 


47 


60 


52 


ft8 


34 


86 


41 


45 


49 


61 


54 


63 


50 


66 


88 


45 


42 


24 


40 


40 


46 


81 


45 


68 


88 


42 


29 


89 


52 


41 


48 


50 


54 


60 


18 


1ft 


18 


26 


24 


25 


25 


10 


18 


28 


80 


33 


86 


28 


29 


88 


89 


37 


40 


82 


88 


48 


— 


51 


53 


51 


57 


56 


60 


62 


9 


15 


13 


16 


18 


20 


11 


21 


1ft 


31 


27 


28 


83 


40 


36 


89 


28 


42 


4ft 


64 


40 


52 


87 


58 


65 


69 


57 


67 


68 


70 


40 


47 


48 


48 


61 


65 










25 


81 


28 


87 


42 


42 


io 


88 


41 


41 


28 


27 


20 


20 


26 


22 


28 


21 


2ft 


28 


45 


55 


60 


57 


58 


78 


78 


68 


69 


70 


18 


23 


1ft 


23 


21 


21 


22 


21 


2ft 


22 


83 


35 


36 


48 


41 


42 


45 


46 


ft2 


87 


34 


83 


— 


— 


■_ 


45 










24 


31 


2ft 


22 


80 


33 


27 


80 


* E 


88 


71 


— 


63 


64 


69 


71 


_ 




63 


76 


40 


56 


62 


63 


61 


65 


64 


60 


83 


81 


24 


31 


22 


29 


26 


28 


80 


82 


8ft 


41 


29 


34 


30 


36 


27 


35 


41 


87 


48 


61 


61 


74 


78 


77 


80 


85 


73 


89 


87 


80 


61 


44 


64 


59 


63 


64 


59 


56 


6ft 


67 


23 


27 


26 


28 


27 


25 


88 


28 






28 


38 


42 


42 


46 


49 


40 


55 


61 


68 


22 


36 


83 


38 


37 


88 


87 


39 


4ft 


47 


— 


23 


18 


15 


22 


17 


22 


23 


27 


27 


18 


15 


19 


23 


18 


24 


22 


27 


28 


24 


41 


53 


64 


52 


50 


58 


40 


67 


69 


70 


25 


55 


36 


31 


38 


86 


37 


48 


88 


85 


16 


20 


1ft 


24 


12 


21 


24 


25 


28 


••• 

27 


21 


30 


20 


25 


25 


82 


81 


34 


28 


20 


52 


74 


74 


76 


86 


81 


88 


86 


94 


04 


22 


21 


34 


29 


28 


29 


35 


23 


24 


16 



Appendix 



8i 



!nd. 




2/4 


2/5 


2/8 


2/0 


2/10 


2/11 


2/15 


2/16 


2/17 


2/18 


M 




29 


35 


32 


27 


24 


25 


81 


34 




28 


42 


M 




_ 


25 


31 


25 


22 


20 


26 


21 




27 


31 


M 




89 


47 


49 


48 


51 


51 


51 


58 




61 


66 


67 




34 


35 


89 


40 


36 


42 


42 


50 




44 


40 


68 




— - 


45 


54 


52 


47 


,— 


37 


_- 




53 


57 


60 




27 




-_i 




— 


— . 


39 


_ 




— 


— 


70 




20 


H 


25 


21 


22 


26 


29 


20 




35 


34 


71 




29 


46 


46 


46 


52 


44 


48 


41 




50 


54 


73 




66 


79 


76 


80 


01 


87 


88 


04 




102 


103 


73 




32 


29 


81 


37 


37 


40 


83 


86 




36 


48 


74 




13 


19 


13 


14 


13 


18 


16 


10 




26 


27 


75 




22 


18 


32 


22 


17 


22 


27 


30 




25 


27 


76 




37 


48 


45 


45 


34 


40 


51 


51 




40 


50 


77 




21 


27 


22 


17 


10 


31 


26 


18 




27 


26 


78 




32 


85 


85 


85 


40 


41 


41 


48 




40 


53 


7» 




30 


53 


62 


67 


74 


75 


67 


70 




70 


83 


80 




58 


74 


69 


86 


82 


85 


92 


06 




04 


102 


81 




46 


56 


64 


60 


68 


73 


60 


66 




64 


63 


82 




29 


42 


40 


42 


40 


41 


45 


_ 




45 


51 


83 




30 


26 


36 


30 


37 


20 


— 


— 




— 


— 


84 




31 


35 


32 


35 


43 


44 


36 


30 




40 


30 


85 




25 


28 


._ 


— . 


— . 


«— 


— 


__ 




— 


.^ 


86 




21 


23 


22 


15 


20 


20 


17 


15 




15 


14 


87 




25 


81 


21 


26 


30 


30 


31 


34 




36 


83 


88 




25 


24 


17 


10 


21 


10 


23 


27 




18 


27 


89 




47 


65 


71 


64 


72 


68 


74 


_- 




_ 


_ 


00 




21 


22 


14 


26 


36 


40 


48 


51 




52 


40 


01 




29 


-~ 


39 


35 


38 


33 


32 


48 




43 


45 


03 




38 


42 


43 


38 


48 


43 


45 


48 




48 


44 


08 




41 


47 


42 


44 


45 


42 


42 


30 




40 






Ind. 




4/14 


4/15 


4/16 


4/10 


4/20 


4/23 


4/26 




4/27 




1 




116 


119 


118 


110 


112 


110 




115 




131 




3 




39 


41 


45 


84 


85 


30 




36 




35 




8 




77 


63 


77 


80 


81 


75 




68 




77 




4 




28 


29 


42 


82 


35 


34 




40 




40 




5 




28 


29 


84 




23 


35 




35 




40 




6 




34 


41 


42 


35 


43 


54 




55 




52 




7 




44 


48 


53 


40 


40 


53 




45 




58 




8 




34 


23 


32 


84 


85 


52 




42 




40 









56 


45 


58 


50 


60 


71 




71 




80 




10 




11 


11 


11 


21 


14 


17 









14 




11 




7 


12 


11 


22 


20 


11 




4 




14 




12 






^_ 




__ 




1^ 




24 




22 




13 




95 


95 


08 


08 


08 


108 




112 




118 




14 




51 


72 


76 


56 


63 


78 




82 




04 




15 




27 


29 


24 


25 


25 


35 




36 




35 




16 




51 


50 


55 


40 


50 


52 




53 




61 




17 




38 


29 


87 


31 


33 


_ 




45 




45 




18 




64 


61 


60 


70 


71 


75 




70 




77 




10 




85 


99 


00 


100 


00 


101 




00 




110 




20 




59 


58 


68 


68 


60 


74 




78 




70 




21 




28 


26 


27 


26 


26 


30 




31 




28 




22 




27 


32 


30 


28 


24 


— 




27 




37 




23 




56 


60 


63 


52 


57 


62 




55 




55 




24 
25 
26 




51 


60 


63 


— 


45 


66 




60 




57 






58 


60 


63 


58 


55 


65 




67 




66 




27 




59 


62 


65 


60 


73 


75 




80 




78 




28 




__ 


18 


22 


23 


28 


23 




22 




27 




29 




32 


38 


22 


47 


46 


21 




46 




42 




80 




55 


44 


50 


48 


60 


73 




70 




66 




31 




18 


14 


21 


13 


13 


12 




15 




4 




82 




46 


53 


50 


31 


47 


48 




47 




55 




83 
84 
85 




76 


72 


78 


68 


68 


80 




77 




78 






45 


4i 


46 


32 


40 


40 




45 




46 




36 




15 


25 


26 


28 


31 


_ 




23 




80 




37 




68 


76 


78^ 


81 


85 


70 




74 




81 




38 




22 


10 


23 


21 


18 


28 




22 




23 




89 
40 
41 




57 


58 


65 


40 


63 


70 




67 




71 






^ 


35 


^ 


42 


45 


48 




51 




50 




42 




54 


73 


74 


87 


72 


47 




03 




60 




43 




71 


81 


83 


81 


70 


85 




85 




80 




44 




42 


42 


41 


82 


80 


80 




33 




24 




50 




33 


45 


42 


80 


46 


52 




46 




43 



82 Correlation of Psychological and Educational Measurements 

Addition (continued) 



dren» 



Ind. 


4/14 


4/16 


4/16 


4/19 


4/20 




4/28 


4/86 


4/27 


51, 




98 




104 


102 


91 




02 




103 


98 


lOO* 


6ft 




_ 




__ 


.« 


^n 




... 




«— 


^— 


— 


68 




28 




87 


31 


41 




85 




_ 


— 


86 


64 




68 




51 


67 


61 




68 




70 


63 


78 


66 




86 




85 


37 


81 




42 




49 


40 


48 


66 




25 




25 


27 


28 




82 




80 


— 


— 


67 




80 




18 


24 






26 




22 


22 


80 


68 




71 




76 


82 


75 




77 




89 


80 


87 


60 




51 




47 


88 


48 




65 




59 


56 


60 


60 




27 




20 


25 


26 




28 




80 


85 


24 


61 




25 






61 


26 




25 




88 


81 


26 


62 




85 




W 


93 


97 




101 




110 


118 


121 


68 




80 




83 


42 


26 




81 




85 


25 


82 


64 




_ 




25 


35 


16 




82 




35 


41 


24 


65 




27 




81 


32 


67 




32 




— . 


29 


28 


66 




60 




67 


64 


57 




66 




65 


64 


74 


67 




49 




58 


52 


54 




64 




50 


55 


78 


68 
68 
70 




57 




— 


65 


59 




64 




56 


66 


72 




81 




zi 


si 


81 




ii 




ii 


ii 


n 


71 




89 




48 


49 


40 




48 




47 


_ 


61 


72 




86 




88 


81 


78 




97 




100 


97 


108 


78 




40 




45 


48 


45 




49 




54 


47 


64' 


74 




24 




23 


31 


24 




31 




85 


30 


48 


76 




27 




81 


31 


24 




83 




86 


38 


28 


76 




50 




61 


57 


48 




50 




64 


61 


66 


77 




20 




23 


19 


20 




17 




25 


83 


82 


78 




41 




89 


38 


34 




89 




39 


51 


46 


78 




87 




88 


94 


80 




— . 




108 


105 


108 


80 




98 




97 


102 


98 




108 




120 


120 


122 


81 




61 




72 


72 


64 




71 




76 


68 


78 


83 




45 




45 


47 


54 




54 




51 


54 


66 


88 




23 




42 


84 


24 




40 




42 


35 


87 


84 




41 




46 


48 


37 




46 




48 


44 


89 


86 




26 




80 


— 


28 




28 




45 


35 


41 


86 




16 




25 


20 


17 




19 




22 


23 


20 


87 




88 




32 


32 


— 




25 




35 


31 


44 


88 
89 
90 




27 




81 


31 


38 




88 




89 


34 


81 




62 




^ 


7i 


69 




66 




56 


n 


M 


91 




38 




49 


_ 


_ 




42 




58 


62 


68 


93 




44 




54 


58 


— 




47 




50 


51 


58 


98 




88 




43 


52 


45 




61 




65 




66 


Copying Addresses 
1, 


: Original scores made in 


1 10 


) minutes by 88 chi 


Ind. 


2/19 


2/23 


2/24 


2/25 


2/26 


3/1 




3/2 


8/8 


3/4 


V5 


1 


7 




10 


19 


18 


18 


16 




17 


17 


10 


15 


2 


15 




19 


13 


21 


22 


21 




18 




22 


26 


8 


8 




9 


10 


17 


14 


16 




16 


17 


18 


18 


4 


10 




10 


14 


17 


13 


15 




13 


11 


14 


15 


6 


16 




18 


19 


24 


22 


,— 




23 


21 


22 


24 


6 


8 




7 


7 


9 


11 


11 




16 


_— 


6 


11 


7 


1 




8 


6 


11 


13 


15 




8 


12 


14 


20 


8 


18 




14 


17 


20 


20 


20 




15 


20 


23 


25 


9 


13 




19 


17 


21 


18 


20 




14 


16 


22 


26 


10 


9 




11 


10 


12 


16 


12 




10 


19 


12 


17 


11 


5 




11 


14 


_ 


22 


22 




17 


25 


25 


28 


12 


6 




11 


i_ 


16 


15 


14 




10 


16 


12 


19 


18 


15 




21 


25 


28 


20 


25 




22 


26 


25 


29 


14 


12 




12 


9 


14 


14 


13 




18 


17 


13 


15 


15 


9 




8 


9 


15 


16 


16 




15 


17 


13 


24 


16 


11 




10 


15 


16 


19 


18 




17 


21 


19 


24 


17 


13 




12 


11 


17 


17 


19 




9 


16 


16 


18 


18 


13 




14 


14 


24 


22 


25 




19 


19 


28 


28 


19 


5 




13 


11 


16 


18 


18 




15 


16 


18 


28 


20 


11 




16 


38 


19 


20 


17 




20 


17 


20 


28 


21 


9 




12 


9 


12 


12 


15 




15 


18 


8 


12 


22 


11 




5 


12 


17 


16 


14 




18 


15 


16 


24 


23 


11 




12 


8 


_ 


14 


21 




16 


17 


13 


22 


24 


17 




19 


19 


24 


24 


23 




20 


23 


25 


25 


25 


15 




15 


17 


18 


23 


18 




19 


21 


17 


24 


26 


12 




13 


17 


20 


18 


21 




18 


19 


18 


20 


27 


15 




17 


20 


25 


25 


26 




26 


29 


31 


29 


28 


9 




11 


10 


14 


14 


18 




16 


18 


18 


19 


29 


IS 




20 


20 


27 


22 


21 




26 


24 


26 


29 



Appendix 



83 



Ind. 


2/19 


2/23 


2/84 


2/26 


2/20 


8/1 


8/2 


8/3 


3/4 


8/5 


30 


17 


20 


25 


23 


25 


21 


22 


23 


24 


28 


ai 


10 


13 




15 


17 


14 


13^ 


12 


17 


11 


n 


14 


17 


18 


20 


21 


12 


10 


25 


03 


29 


88 


7 


8 


13 


14 


19 


13 


18 


18 


15 


18 


8« 
















— k 


— . 


— 


88 


14 


m 


15 


18 


20 


19 


17 


19 


20 


25 


88 


10 


14 


ir 


la 


14 


19 


18 


17 


18 


18 


87 


13 


18 


21 


21 


21 


21 


13 


15 


21 


28 


88 


11 


11 


10 


14 


15 


14 


15 


14 


17 


17 


89 
40 
41 


12 


10 


14 


19 


18 


17 


18 


14 


17 


28 


14 


11 


17 


18 


10 


19 


17 


20 


20 


21 


48 


19 


21 


25 


26 


23 


20 


29 


21 


30 


29 


48 


12 


5 


12 


19 


20 


11 


17 


19 


10 


20 


44 


11 




^ 


17 


_ 


10 


10 


15 


10 


20 


80 


15 


^ 


18 


23 


25 




19 


20 


24 


80 


61 


12 


18 


19 


19 


24 


19 


10 


20 


26 


24 


88 


2 


—^ 





14 


14 


12 


11 


11 


13 


15 


58 


— . 


15 


10 


18 


19 


19 


18 


22 


23 


27 


54 


10 


13 


21 


21 


23 


19 


27 


23 


21 


27 


55 





12 


12 


10 


10 


20 


20 


10 


10 


28 


58 





13 


17 


17 


19 


20 


10 


24 


24 


25 


57 


11 


12 


17 


14 


16 


10 


15 


13 


19 


19 


58 


13 


15 


15 


17 


10 


19 


10 


20 


20 


20 


50 


10 


13 


11 


10 


18 


19 


15 


1» 


17 


21 


08 


13 


14 


15 


17 


19 


10 


18 


20 


19 


28 


01 


9 


11 


10 


12 


10 


11 


12 


12 


15 


10 


88 


19 


20 


21 


23 


23 


19 


20 


17 


24 


23 


08 





11 


13 


12 


17 


15 


14 


10 


18 


21 


04 


13 


18 


22 


19 


24 


22 


22 


22 


22 


28 


05 


9 


8 


7 


— 


9 


15 


14 


5 


9 


18 


00 


10 


5 


8 


11 


15 


10 


10 


10 


16 


18 


or 


18 


12 


12 


15 


19 


20 


17 


19 


14 


21 


08 
00 

70 


8 


10 


18 


10 


23 


18 


18 


19 


— 


24 


12 


14 


14 


18 


19 


ii 


15 


20 


23 


10 


71 


10 


11 


14 


14 


18 


18 


16 


19 


10 


25 


72 


12 


17 


20 


21 


18 


17 


19 


22 


18 


24 


78 


10 


10 


5 


13 


13 


14 


12 


12 


10 


10 


74 


8 


14 


18 


17 


19 


10 


18 


16 


14 


21 


75 


5 


7 


9 


14 


19 


17 


10 


19 


10 


20 


70 


21 


19 


28 


27 


20 


24 


29 


28 


31 


31 


77 


11 


18 


20 


22 


21 


23 


22 


21 


24 


24 


78 


11 


15 


19 


11 


19 


19 


13 


10 


19 


24 


70 


10 


12 


17 


20 


19 


— 


13 


19 


14 


20 


80 


10 


10 


10 


17 


21 


18 


15 


19 


20 


21 


81 


20 


24 


23 


26 


20 


27 


28 


28 


17 


80 


88 


12 


19 


20 


21 


22 


20 


21 


19 


17 


20 


88 


— 


10 


17 


22 


18 


— 


22 


19 


19 


26 


84 


8 


15 


14 


18 


18 


12 


18 


19 


19 


.28 


85 


_ 


— 


— . 


— 


9 


— 


10 


13 


14 


17 


80 


11 


8 


8 


9 


15 


19 


12 


17 


10 


20 


87 


8 


10 


10 


17 


10 


15 


18 


17 


14 


23 


88 
80 
00 


5 


8 


11 


15 


14 


17 


10 


10 


13 


10 


li 


li 


15 


10 


19 


si 


17 


21 


19 


27 


91 


11 


17 


15 


20 


18 


18 


19 


18 


22 


26 


08 


15 


18 


21 


22 


21 


22 


19 


22 


20 


25 


08 


11 


10 


19 


18 


— 


^— 


19 


20 


21 


25 


Ind. 


4/14 


4/15 


4/10 


14/9 


4/20 


4/21 


4/22 


4/28 


4/20 


4/27 




18 


20 


21 


21 


21 


19 


24 


20 


22 


21 




20 


28 


28 


26 


25 


28 


20 


30 


30 


82 




18 


22 


19 


20 


21 


19 


23 


22 


21 


22 




18 


10 


14 


18 


18 


20 


15 


10 


18 


26 




19 


20 


20 


— 


22 


24 


28 


26 


24 


20 




14 


13 


12 


13 


10 


18 


15 


10 


18 


19 




19 


13 


17 


21 


21 


10 


16 


20 


22 


22 




20 


80 


27 


20 


28 


28 


32 


32 


34 


39 




20 


28 


25 


22 


20 


20 


28 


29 


21 


29 




17 


21 


18 


18 


18 


15 


10 


18 


23 


22 




24 


20 


25 


34 


20 


31 


31 


34 


25 


34 




■~. 


— 


— . 


— 


^— 


^— 


_ 


__ 


10 


13 




27 


29 


24 


32 


31 


81 


31 


34 


38 


34 




23 


19 


21 


23 


21 


19 


15 


23 


25 


21 




21 


22 


22 


20 


21 


21 


22 


25 


20 


25 




17 


21 


20 


10 


25 


22 


23 


24 


24 


29 



84 Correlation of Psychological and Educational Measurements 

Copying Addresses (continued) 



Ind. 


4/14 


4/15 


4/10 


14/9 


4/20 


4/21 


4/22 


4/28 


4/20 


4/27 


17 


19 


17 


19 


17 


19 


20 


19 


— 


24 


22 


18 


20 


27 


25 


20 


22 


20 


28 


31 


81 


82 


19 


21 


20 


18 


18 


21 


22 


24 


21 


28 


27 


90 


28 


22 


20 


27 


24 


28 


81 


25 


88 


20 


21 


18 


10 


17 


14 


18 


17 


10 


17 


10 


18 


22 


24 


24 


18 


18 


21 


10 


22 


m— 


28 


27 


28 


21 


23 


20 


19 


21 


22 


25 


20 


25 


25 


24 
25 
26 


80 


27 


29 


— 


29 


82 


34 


85 


80 


88 


20 


20 


24 


24 


2i 


24 


27 


» 


» 


» 


27 


29 


27 


35 


82 


32 


30 


87 


37 


80 


85 


28 


— 


18 


19 


24 


21 


21 


19 


28 


25 


19 


29 


27 


80 


29 


22 


80 


30 


87 


31 


34 


89 


80 


24 


20 


30 


20 


29 


27 


27 


81 


82 


82 


81 


18 


19 


20 


15 


20 


19 


19 


25 


24 


22 


82 


80 


28 


20 


18 


24 


27 


27 


28 


88 


81 


88 

34 
86 


17 


20 


19 


10 


20 


19 


21 


21 


22 


17 


^ 


20 


23 


27 


20 


25 


20 


^ 


ii 


M 


80 


19 


18 


15 


14 


20 


21 


23 


— 


24 


24 


87 


25 


23 


23 


23 


24 


24 


25 


23 


25 


21 


88 


10 


15 


15 


14 


19 


19 


18 


20 


20 


22 


80 
40 
41 


17 


23 


21 


20 


22 


22 


20 


22 


20 


20 


20 


S^ 


19 


17 


20 


28 


^ 


21 


24 


18 


42 


31 


29 


82 


80 


83 


84 


87 


34 


88 


82 


43 


14 


17 


18 


15 


21 


17 


21 


24 


24 


21 


44 


20 


22 


20 


20 


23 


22 


23 


23 


25 


27 


50 


83 


28 


34 


20 


33 


32 


20 


80 


34 


84 


51 


98 


20 


28 


22 


22 


29 


23 


20 


27 


80 


52 


08 


10 


18 


17 


21 


18 


21 


20 


22 


19 


58 


28 


29 


25 


20 


24 


23 


84 


^— 


-^ 


81 


54 


53 


51 


21 


22 


24 


20 


28 


29 


28 


31 


55 


85 


85 


18 


18 


21 


21 


14 


20 


18 


24 


50 


25 


25 


25 


28 


23 


27 


82 


80 


— 


._ 


57 


20 


18 


19 


14 


20 


21 


20 


22 


20 


27 


58 


71 


70 


23 


28 


24 


20 


80 


29 


30 


31 


59 


51 


47 


17 


15 


23 


15 


20 


25 


23 


25 


00 


27 


29 


21 


18 


23 


20 


21 


23 


22 


21 


01 


25 


_ 


14 


14 


15 


10 


18 


18 


17 


17 


02 


85 


98 


18 


28 


28 


81 


80 


20 


29 


28 


08 


80 


33 


18 


19 


21 


18 


25 


18 


23 


21 


04 


•^ 


25 


25 


25 


25 


_ 


23 


28 


28 


29 


05 


27 


31 


17 


18 


15 


— . 


^— 


— 


19 


17 


00 


00 


57 


19 


20 


21 


18 


19 


20 


21 


24 


07 


49 


58 


19 


19 


18 


20 


24 


25 


80 


24 


08 
00 
70 


57 


01 


24 


28 


20 


21 


23 


20 


24 


27 


31 


la 


25 


2i 


20 


25 


24 


27 


21 


io 


71 


89 


48 


17 


25 


20 


20 


20 


21 


-_ 


28 


72 


80 


88 


21 


21 


21 


20 


24 


20 


29 


27 


78 


40 


45 


18 


14 


18 


18 


21 


18 


19 


22 


74 


24 


23 


21 


18 


21 


19 


24 


22 


21 


28 


75 


27 


31 


20 


23 


22 


22 


28 


80 


31 


28 


70 


59 


01 


29 


28 


82 


88 


84 


35 


30 


80 


77 


20 


23 


24 


23 


20 


20 


20 


27 


29 


28 


78 


41 


29 


21 


19 


23 


22 


24 


28 


20 


80 


70 


87 


88 


27 


23 


-— 


23 


20 


21 


27 


20 


80 


98 


97 


23 


19 


28 


20 


28 


82 


32 


81 


81 


01 


72 


80 


80 


30 


40 


37 


88 


40 


88 


82 


45 


45 


27 


27 


25 


80 


24 


29 


29 


80 


83 


22 


42 


20 


21 


19 


24 


81 


81 


80 


80 


84 


41 


40 


19 


22 


25 


20 


29 


82 


24 


28 


85 


20 


80 


— 


15 


10 


22 


18 


23 


20 


22 


80 


10 


25 


10 


11 


21 


19 


25 


23 


22 


18 


87 


83 


32 


20 


— . 


17 


14 


23 


23 


22 


25 


88 
89 
90 


27 


31 


10 


15 


14 


17 


15 


19 


21 


14 


C^ 


92 


^ 


25 


ii 


i4 


^ 


81 


81 


H 


01 


88 


49 


— 


— 


22 


25 


20 


24 


24 


25 


92 


44 


54 


24 


— 


25 


25 


28 


20 


25 


25 


98 


88 


43 


27 


22 


25 


23 


20 


27 




28 



' Appendix 



8s 



Handwriting : Original scores made in 4 minutes by 88 children. 



Ind. 

1 

8 
8 
4 
S 

7 

8 

9 
10 
11 
12 
13 
14 
16 
18 
17 
18 
19 

ao 
ai 

22 
23 
24 
25 
28 
27 
28 
29 
30 
81 
82 
33 
34 
35 
88 
37 
38 
39 
40 
41 
42 
48 
44 
60 
51 
52 
53 
54 
56 
58 
57 
58 
59 
80 
81 
82 
83 
84 
85 
88 
87 
88 
89 
70 
71 
72 
73 
74 
75 
78 
77 
78 
79 
80 
81 
82 
83 
84 



2/19 



2/28 



2/24 



2/25 



2/28 



83 
87 
88 
88 
78 
80 
86 
88 
86 
58 
81 
80 
107 
87 
54 
88 
55 
88 
84 
70 
55 
76 
71 
88 
85 
84 
78 
75 
75 
55 
76 
83 
81 



88 
88 

75 

84 
74 
88 
98 
72 
68 
84 
95 
99 
80 

83 



70 
80 
81 
62 
81 
75 
84 
81 
81 
57 
81 
80 
95 
79 
59 
82 
55 
60 
85 
79 
70 
87 
87 
75 
88 
59 
79 
79 
81 
81 
79 
90 
90 



67 
68 
76 
79 
74 
79 

104 
68 
65 
83 
93 

100 
73 

82 



62 
80 
78 
88 
79 
70 
79 
55 
62 
61 
60 
68 
81 
65 
46 
85 
49 
70 
81 
87 
65 
76 
60 
72 
52 
59 
72 
74 
84 
63 
75 
97 
82 



70 
67 
64 
75 
69 
78 
89 
70 
58 
75 
79 
98 
84 
71 
78 



58 
82 

71 
62 
65 
88 
78 
47 
68 
49 
54 
50 
68 
58 
89 
86 
48 
70 
55 
59 
66 
68 
53 
58 
53 
53 
78 
72 
73 
55 
54 
87 
68 



88 
72 
77 
87 
66 
60 
78 
83 
68 
48 
54 

85 

61 
45 
77 
48 
59 
55 
64 
54 
73 
54 
85 
59 
64 
83 
66 
64 
51 

88 

68 



59 
72 
66 

64 
72 
55 

72 
38 
87 
47 
51 

64 
66 

45 

77 
48 
85 
59 
88 
59 
70 
60 
60 
50 
58 
74 
88 
64 
48 

85 

85 



78 
92 
72 
57 
86 
80 
63 
40 
68 
44 
53 
86 
101 
77 
48 
72 
55 
64 
82 
89 
81 
73 
57 
58 
77 
60 
80 
62 
71 

58 

71 
78 



71 
85 

88 
60 
87 
81 
87 
89 
85 
72 
54 
85 
94 
80 
45 
76 
54 
65 
65 
76 
85 
88 
67 
66 
60 
70 
87 
85 
75 

49 
93 
70 



64 
64 
68 
68 
65 
68 
92 
80 
52 
82 
62 
92 
76 
62 
72 



73 
58 

70 
74 
53 
80 
87 
72 
54 
88 
88 
95 
78 
71 
71 



59 
58 
66 

72 
48 
72 
82 
73 
51 
77 
70 
98 
75 
60 
89 



79 
68 
78 
72 
73 
78 
74 
64 
48 
78 
88 
104 
83 
88 
61 



78 
69 
83 
80 
81 
95 
93 
75 
60 
79 
93 
100 
79 
82 
80 



67 
85 

75 
51 
89 
85 
85 
51 
60 
55 
44 
100 
88 
89 
42 
71 
48 
88 
67 
67 
57 
73 
55 
56 
60 
81 
82 
64 
68 
49 
41 
71 
67 



72 
48 
66 
69 
72 
80 
101 
64 
81 
75 
90 
90 
79 
65 
8& 



75 
72 
79 
59 
73 
58 
68 
52 
73 
63 
55 
85 
107 
88 
50 
71 
60 
59 
66 
73 
58 
88 
73 
72 
64 
72 
78 
80 
78 
SO 
67 
84 
59 



70 


81 


70 


61 


72 


68 


74 


78 


76 


74 


101 


89 


75 


69 


73 


72 


85 


69 


75 


72 


78 


98 


70 


63 


73 


81 


70 


72 


54 


61 


51 


48 


54 


43 


50 


48 


51 


48 


52 


50 


68 


74 


58 


56 


53 


57 


53 


66 


68 


71 


88 


81 


81 


75 


57 


42 


75 


ii 


^ 


95 


101 


88 


79 


78 


75 


71 


78 


88 


88 


88 


73 


81 


68 


60 


69 


73 


87 


75 


71 


79 


69 


75 


— 


__ 














93 


88 


92 


68 


H 


76 


96 


97 


S» 


98 


79 


75 


84 


78 


77 


71 


83 


87 


61 


78 


60 


54 


— 


— 


51 


52 


59 


60 


54 


85 


— 


— 


86 


61 


78 


60 


67 


84 


81 


75 


85 


78 


78 


84 


71 


68 


75 


71 


85 


86 


69 


51 


78 


77 


50 


60 


67 


75 


60 


69 


95 


89 


90 


78 


94 


84 


98 


102 


98 


105 


69 


67 


60 


59 


60 


48 


48 


47 


45 


60 
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